KIP-1199 — Add max record count limit to FetchRequest

Discussion ConsumerProtocol

Proposes adding a MaxRecords field to FetchRequest and a corresponding fetch.max.message.count consumer config to limit the number of messages returned per fetch regardless of byte size. Kafka consumers can only bound fetch size in bytes; workloads with rate-limiting requirements based on message count (common in downstream processing pipelines) must over-fetch and discard records, wasting bandwidth and increasing offset management complexity.

Protocol Impact

Fetch · ShareFetch

Details