conduktor.io ↗

KIP-987 — Connect Static Assignments

Discussion Connect

Proposes adding static (manual) task assignment to Kafka Connect's distributed mode, allowing operators to pin connectors/tasks to specific worker nodes instead of relying on the existing rebalancing algorithms. The current eager and cooperative scheduling algorithms rebalance all tasks on any cluster membership change, causing unnecessary task restarts when operators only need to change a single task's placement.

Details

AuthorGreg Harris
StatusDiscussion
JIRAKAFKA-15559
WikiView on Apache Wiki
Created2023-10-03
Last Modified2023-10-18
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.