conduktor.io ↗

KIP-846 — Source/sink node metrics for Consumed/Produced throughput in Streams

Accepted Kafka 3.3 StreamsMetrics

Adds bytes-consumed-total, records-consumed-total, bytes-produced-total, and records-produced-total metrics scoped to stream processor source and sink nodes, tagged with thread-id, task-id, processor-node-id, and topic. The existing metrics only exposed throughput at the client or subtopology level; there was no per-node, per-topic view of produced throughput or a symmetric consumed counterpart at the source node level.

Details

AuthorA. Sophie Blee-Goldman
StatusAccepted
Kafka Version3.3
JIRAKAFKA-13945
WikiView on Apache Wiki
Created2022-05-28
Last Modified2022-06-08
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.