conduktor.io ↗

KIP-471 — Expose RocksDB Metrics in Kafka Streams

Accepted Kafka 2.4 StreamsMetrics

Exposes RocksDB internal statistics (block cache hits, compaction stats, memtable metrics, etc.) as Kafka Streams JMX metrics via the existing metrics reporter infrastructure. RocksDB is the storage backend for stateful Streams operators, but its performance bottlenecks (cache pressure, write stalls) were invisible without attaching a separate JVM profiler or reading dump files.

Details

AuthorBruno Cadonna
StatusAccepted
Kafka Version2.4
JIRAKAFKA-6498
WikiView on Apache Wiki
Created2019-05-17
Last Modified2019-06-21
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.