conduktor.io ↗

KIP-811 — Add config repartition.purge.interval.ms to Kafka Streams

Accepted Kafka 3.2 Streams

Rate-limits the explicit log-truncation requests that Kafka Streams sends for repartition topics so they are not issued on every commit. When `commit.interval.ms` is very low (e.g. under `exactly_once_v2`) the resulting flood of `DeleteRecords` RPCs creates significant broker overhead.

Details

AuthorNicholas Telford
StatusAccepted
Kafka Version3.2
JIRAKAFKA-13549
WikiView on Apache Wiki
Created2021-12-20
Last Modified2022-01-18
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.