conduktor.io ↗

KIP-964 — Have visibility when produce requests become "async"

Discussion BrokerMetrics

Proposes adding a broker metric that indicates when produce writes become synchronous (page cache dirty threshold reached), distinguishing async (memory write) from sync (disk flush) I/O paths. Operators currently have no Kafka-native signal to detect dirty-page saturation, forcing them to correlate OS-level metrics with producer timeouts after the fact.

Details

AuthorSergio Troiano
StatusDiscussion
WikiView on Apache Wiki
Created2023-08-07
Last Modified2023-08-08
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.