conduktor.io ↗

KIP-1335 — Bounded concurrency for partition reassignment via kafka-reassign-partitions.sh

Discussion AdminBroker

Adds tool-only pacing controls to kafka-reassign-partitions.sh --execute: --reassignment-batch-size caps how many partitions are submitted per step, --incremental keeps at most N reassignments in flight from a deterministic (topic, partition) queue, and --reassignment-poll-interval-ms controls polling between submissions, all built on existing alterPartitionReassignments/listPartitionReassignments Admin calls with no broker or controller changes. Today the tool submits the entire reassignment JSON in a single AdminClient call, so large plans burst replication traffic and controller work, and --throttle bounds bandwidth but not how many partitions move simultaneously, forcing operators to hand-split JSON files or wrap the tool in ad hoc scripts.

Details

AuthorManan Gupta
StatusDiscussion
JIRAKAFKA-20561
WikiView on Apache Wiki
Created2026-05-06
Last Modified2026-06-01
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.