KIP-607 — Add Metrics to Kafka Streams to Report Properties of RocksDB
Accepted Kafka 2.7 StreamsMetrics
Adds RocksDB-level metrics to Kafka Streams task metrics (e.g., `rocksdb-total-sst-files-size`, `rocksdb-live-sst-files-size`, `rocksdb-estimate-num-keys`, `rocksdb-block-cache-usage`) using RocksDB property queries rather than the statistics API. Existing KIP-471 RocksDB metrics use the RocksDB statistics API which has measurable performance overhead; property-based metrics are cheaper and expose memory/disk usage not covered by statistics.
Details
| Author | Bruno Cadonna |
| Status | Accepted |
| Kafka Version | 2.7 |
| JIRA | KAFKA-9924 |
| Wiki | View on Apache Wiki |
| Created | 2020-05-05 |
| Last Modified | 2020-09-07 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.