conduktor.io ↗

KIP-540 — Implement per key stream time tracking

Discussion Streams

Proposes per-key stream time tracking in Kafka Streams, where stream time advances independently for each key rather than as a single high-watermark across all records in a partition. The global per-partition stream time model incorrectly advances time for all keys when any key's record has a high timestamp, causing premature window closing and grace period expiry for keys whose own data is late or sparse.

Details

AuthorRichard Yu
StatusDiscussion
JIRAKAFKA-8769
WikiView on Apache Wiki
Created2019-10-19
Last Modified2019-11-10
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.