KIP-223 — Add per-topic min lead and per-partition lead metrics to KafkaConsumer
Accepted Kafka 2.0 ConsumerMetrics
KIP-223 adds per-partition consumer lead metrics (`records-lead`, `records-lead-avg`, `records-lead-min`) and a global `records-lead-min` metric to `KafkaConsumer`'s `consumer-fetch-manager-metrics` group. Lag measures how far behind the high watermark a consumer is, but there was no metric for how far ahead of the log-start-offset the consumer is—a value near zero signals that the consumer is about to stall or lose data due to log retention.
Details
| Author | huxihx |
| Status | Accepted |
| Kafka Version | 2.0 |
| JIRA | KAFKA-6184 |
| Wiki | View on Apache Wiki |
| Created | 2017-11-09 |
| Last Modified | 2017-12-13 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.