KIP-443 — Return to default segment.ms and segment.index.bytes in Streams repartition topics
Accepted Kafka 2.3 StreamsBroker
Removes Kafka Streams' overrides of `segment.ms` (set to 1 minute) and `segment.index.bytes` (set to 52428800) for internal repartition topics, reverting to broker defaults. The aggressive `segment.ms=1min` override caused excessive log segment rolling on low-traffic repartition topics, leading to large numbers of small segments that impacted compaction performance and were the root cause of KAFKA-7190.
Details
| Author | Guozhang Wang |
| Status | Accepted |
| Kafka Version | 2.3 |
| JIRA | KAFKA-7190 |
| Wiki | View on Apache Wiki |
| Created | 2019-03-27 |
| Last Modified | 2019-04-03 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.