conduktor.io ↗

KIP-81 — Bound Fetch memory usage in the consumer

Accepted Consumer

Adds a `max.bytes` consumer fetch configuration that caps the total bytes returned across all partitions in a single `FetchResponse`, independent of per-partition limits. Without a global cap, a consumer subscribed to many partitions would issue parallel fetches to all brokers owning those partitions, making total memory usage unbounded relative to the number of partitions.

Protocol Impact

Fetch

Details

AuthorMickael Maison
StatusAccepted
JIRAKAFKA-4133
WikiView on Apache Wiki
Created2016-09-10
Last Modified2021-07-30
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.