conduktor.io ↗

KIP-221 — Enhance DSL with Connecting Topic Creation and Repartition Hint

Accepted Kafka 2.6 Streams

Allows Kafka Streams DSL users to specify a `repartitionFactor` hint on repartition operations and to explicitly name and configure repartition topics via a `Repartitioned` object, giving control over the number of repartition topic partitions independent of the upstream sub-topology. Without this, downstream parallelism was rigidly tied to upstream source partition counts, preventing optimal scaling of stateful operations.

Details

AuthorJeyhun Karimov
StatusAccepted
Kafka Version2.6
JIRAKAFKA-6037
WikiView on Apache Wiki
Created2017-11-04
Last Modified2020-05-19
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.