conduktor.io ↗

KIP-443 — Return to default segment.ms and segment.index.bytes in Streams repartition topics

Accepted Kafka 2.3 StreamsBroker

Removes Kafka Streams' overrides of `segment.ms` (set to 1 minute) and `segment.index.bytes` (set to 52428800) for internal repartition topics, reverting to broker defaults. The aggressive `segment.ms=1min` override caused excessive log segment rolling on low-traffic repartition topics, leading to large numbers of small segments that impacted compaction performance and were the root cause of KAFKA-7190.

Details

AuthorGuozhang Wang
StatusAccepted
Kafka Version2.3
JIRAKAFKA-7190
WikiView on Apache Wiki
Created2019-03-27
Last Modified2019-04-03
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.