KIP-989 — Improved StateStore Iterator metrics for detecting leaks
Accepted Kafka 3.8 StreamsMetrics
Adds num-open-iterators and thread-open-iterators metrics per StateStore in Kafka Streams to expose the count of currently open (potentially leaked) store iterators. Iterator leaks on RocksDB stores pin in-memory blocks and cause memory growth, but the existing block-cache-pinned-usage metric reports shared block cache usage without identifying which store is responsible.
Details
| Author | Nicholas Telford |
| Status | Accepted |
| Kafka Version | 3.8 |
| JIRA | KAFKA-15541 |
| Wiki | View on Apache Wiki |
| Created | 2023-10-04 |
| Last Modified | 2024-05-16 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.