conduktor.io ↗

KIP-539 — Add mechanism to flush records out in low volume suppression buffers

Discussion Streams

KIP-539 adds a `Suppressed.untilWallClockTimeLimit(Duration, BufferConfig)` factory method that flushes suppression buffer entries based on wall-clock elapsed time rather than waiting indefinitely for stream time to advance. In low-traffic scenarios, stream time cannot advance because no new records arrive to update it, leaving buffered records permanently stuck in suppression operators and preventing downstream results from being emitted.

Details

AuthorRichard Yu
StatusDiscussion
JIRAKAFKA-8769
WikiView on Apache Wiki
Created2019-10-17
Last Modified2019-10-22
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.