KIP-782 — Expandable batch size in producer
Discussion Producer
Introduces a `batch.max.bytes` producer config that controls the maximum size at which a batch is drained from the accumulator, decoupling it from `batch.size` which governs memory allocation. Currently `batch.size` serves both roles, forcing operators to choose between memory waste (large allocation) and low throughput (small batch), with no way to tune the two concerns independently.
Details
| Author | Luke Chen |
| Status | Discussion |
| Wiki | View on Apache Wiki |
| Created | 2021-10-16 |
| Last Modified | 2021-11-05 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.