KIP-848 — The Next Generation of the Consumer Rebalance Protocol

Accepted Kafka 3.6 Consumer

Replaces the Classic stop-the-world consumer rebalance protocol with an incremental, server-side protocol where each consumer independently heartbeats and the broker's group coordinator manages assignment reconciliation without a synchronization barrier. The Classic protocol's full-group sync (all members stop, all rejoin) causes throughput disruption proportional to group size, and its thick client-side assignor design creates complex failure modes and slow recovery.

Protocol Impact

OffsetCommit v9/v10 · OffsetFetch v9/v10 · ListGroups v5 · ConsumerGroupHeartbeat v1 · ConsumerGroupDescribe

Details