KIP-983 — Full speed async processing during rebalance
Discussion Consumer
Proposes a new Java consumer API mode where partitions not being revoked during a cooperative rebalance continue processing at full speed while the application asynchronously drains revoked partitions before committing. The current asynchronous processing pattern blocks the entire poll loop during rebalance to prevent offset commit races, stalling throughput on all partitions even those unaffected by the rebalance.
Details
| Author | Erik van Oosten |
| Status | Discussion |
| Wiki | View on Apache Wiki |
| Created | 2023-09-23 |
| Last Modified | 2023-10-14 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.