conduktor.io ↗

KIP-770 — Replace "buffered.records.per.partition" & "cache.max.bytes.buffering" with "{statestore.cache}/{input.buffer}.max.bytes"

Discussion Kafka 3.4 Streams

Deprecates buffered.records.per.partition in favor of input.buffer.max.bytes (a global byte budget distributed evenly across stream threads) and renames cache.max.bytes.buffering to statestore.cache.max.bytes. The per-partition record count limit is scale-dependent and record-size-agnostic, making it impossible to reliably bound memory consumption across diverse workloads.

Details

AuthorSagar Rao
StatusDiscussion
Kafka Version3.4
JIRAKAFKA-13152
WikiView on Apache Wiki
Created2021-08-22
Last Modified2022-12-01
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.