conduktor.io ↗

KIP-782 — Expandable batch size in producer

Discussion Producer

Introduces a `batch.max.bytes` producer config that controls the maximum size at which a batch is drained from the accumulator, decoupling it from `batch.size` which governs memory allocation. Currently `batch.size` serves both roles, forcing operators to choose between memory waste (large allocation) and low throughput (small batch), with no way to tune the two concerns independently.

Details

AuthorLuke Chen
StatusDiscussion
WikiView on Apache Wiki
Created2021-10-16
Last Modified2021-11-05
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.