conduktor.io ↗

KIP-415 — Incremental Cooperative Rebalancing in Kafka Connect

Accepted Kafka 2.3 Connect

Replaces Connect's eager stop-the-world rebalance with an incremental cooperative protocol where only tasks that need to move are stopped and restarted, leaving unaffected tasks running throughout the rebalance. The existing eager protocol revokes all task assignments at the start of every rebalance, causing a full restart of all connectors whenever any single connector is added, updated, or removed.

Details

AuthorKonstantine Karantasis
StatusAccepted
Kafka Version2.3
JIRAKAFKA-5505
WikiView on Apache Wiki
Created2019-01-11
Last Modified2019-05-17
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.