KIP-74 — Add Fetch Response Size Limit in Bytes

Accepted Kafka 1.0 ConsumerProtocol

Adds a `max.partition.fetch.bytes` replacement: introduces `fetch.max.bytes` as a total fetch response size limit across all partitions in a single `FetchRequest`, alongside the existing per-partition `max.partition.fetch.bytes`. Without a global fetch size cap, a consumer subscribed to thousands of partitions must allocate `max.partition.fetch.bytes * numPartitions` of heap for fetch responses, which can be gigabytes.

Protocol Impact

Fetch

Details