KIP-517 — Add consumer metrics to observe user poll behavior
Accepted Kafka 2.4 ConsumerMetrics
Adds consumer metrics including `poll-idle-ratio`, `time-between-poll-avg`, `time-between-poll-max`, and `last-poll-seconds-ago` to expose how frequently and how promptly the application calls `Consumer.poll()`. Without these metrics, there is no observable signal to distinguish whether a `max.poll.interval.ms` violation is caused by slow record processing or by the application neglecting to call `poll()` frequently enough.
Details
| Author | Kevin Lu |
| Status | Accepted |
| Kafka Version | 2.4 |
| JIRA | KAFKA-8874 |
| Wiki | View on Apache Wiki |
| Created | 2019-09-04 |
| Last Modified | 2019-10-17 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.