KIP-1114 — Introducing Chunk in Partition

Discussion Broker

Proposes splitting a Kafka partition's data into immutable inactive chunks and a single active chunk, allowing inactive chunks to be reassigned to different brokers independently of the active chunk. The entire partition replica is managed as one unit for assignment and rebalancing, making partition moves expensive even when only the active (tail) data matters for most operations.

Protocol Impact

Metadata

Details