conduktor.io ↗

KIP-615 — add ConstrainedCooperativeStickyAssignor

Discarded Kafka 2.4.2 Consumer

Proposes a `ConstrainedCooperativeStickyAssignor` that trades perfect balance for faster assignment computation when the number of consumers and partitions is very large. The existing `CooperativeStickyAssignor`'s algorithm becomes prohibitively slow (2.5+ minutes reported) with 2100+ consumers due to its O(n²) complexity in optimizing for both stickiness and perfect balance simultaneously.

Details

AuthorA. Sophie Blee-Goldman
StatusDiscarded
Kafka Version2.4.2
JIRAKAFKA-9987
WikiView on Apache Wiki
Created2020-05-13
Last Modified2020-05-14
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.