KIP-932 — Queues for Kafka

Accepted Kafka 3.9 ConsumerBroker

Introduces Share Groups to Kafka, providing queue semantics with cooperative multi-consumer consumption, per-message acknowledgment, delivery counts, and redelivery of unacknowledged records. Classic consumer groups couple parallelism to partition count and lack per-message acknowledgment, making them unsuitable for work-queue patterns where tasks are independent, consumers vary dynamically, and failed work must be redelivered.

Protocol Impact

FindCoordinator v6 · ShareGroupHeartbeat v0/v1 · ShareGroupDescribe v0/v1 · ShareFetch v0/v1 · ShareAcknowledge v0/v1 · WriteShareGroupState v0 · ReadShareGroupStateSummary v0 · DescribeShareGroupOffsets v0 · ListGroups · AlterShareGroupOffsets · DeleteShareGroupOffsets · DeleteShareGroupState · InitializeShareGroupState · ReadShareGroupState

Details