KIP-41 — Consumer Max Records

Accepted Kafka 1.0 Consumer

KIP-41 introduces the `max.poll.records` configuration for `KafkaConsumer`, capping the number of records returned by a single `poll()` call. Without this limit, `poll()` returns all buffered records up to `fetch.max.bytes`, which can be arbitrarily large, making it impossible to bound per-poll processing time and causing consumer poll timeout violations when downstream processing is slow.

Details