conduktor.io ↗

KIP-333 — Add faster mode of rebalancing

Discussion Consumer

Proposes a fast-path rebalance mechanism for consumers that are returning from failure, allowing them to resume from their last committed offset rather than waiting for a full group rebalance to complete. After a crash and restart, the standard rebalance protocol introduces a lag proportional to the gap between the last committed offset and the current LEO, which is unacceptable for low-latency applications.

Protocol Impact

JoinGroup · LeaveGroup

Details

AuthorRichard Yu
StatusDiscussion
JIRAKAFKA-7132
WikiView on Apache Wiki
Created2018-07-05
Last Modified2018-07-23
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.