KIP-1071 — Streams Rebalance Protocol

Accepted Kafka 4.1 StreamsConsumer

Introduces a native Streams Rebalance Protocol that moves task assignment from a client-side custom PartitionAssignor piggyback to a server-side broker protocol built on the KIP-848 group coordinator. The existing approach serializes Streams task assignment state into the consumer group join/sync protocol payload, coupling Streams scheduling correctness to the slow, stop-the-world Classic rebalance and preventing incremental assignment.

Protocol Impact

StreamsGroupHeartbeat · Fetch · OffsetCommit · OffsetFetch · JoinGroup · Heartbeat · SyncGroup · ListGroups · ConsumerGroupHeartbeat · StreamsGroupDescribe

Details