conduktor.io ↗

KIP-607 — Add Metrics to Kafka Streams to Report Properties of RocksDB

Accepted Kafka 2.7 StreamsMetrics

Adds RocksDB-level metrics to Kafka Streams task metrics (e.g., `rocksdb-total-sst-files-size`, `rocksdb-live-sst-files-size`, `rocksdb-estimate-num-keys`, `rocksdb-block-cache-usage`) using RocksDB property queries rather than the statistics API. Existing KIP-471 RocksDB metrics use the RocksDB statistics API which has measurable performance overhead; property-based metrics are cheaper and expose memory/disk usage not covered by statistics.

Details

AuthorBruno Cadonna
StatusAccepted
Kafka Version2.7
JIRAKAFKA-9924
WikiView on Apache Wiki
Created2020-05-05
Last Modified2020-09-07
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.