conduktor.io ↗

KIP-93 — Improve invalid timestamp handling in Kafka Streams

Accepted Streams

KIP-93 changes the `TimestampExtractor` interface to receive the previously extracted timestamp as a hint and return a non-negative timestamp instead of propagating negative values, and adds a configurable `default.timestamp.extractor` that uses the hint to carry forward the last valid timestamp. Negative timestamps (returned for pre-0.10 message-format records or by custom extractors) caused Kafka Streams to crash with an unhandled exception because time-based operators like windowed aggregates and joins cannot handle them.

Details

AuthorMatthias J. Sax
StatusAccepted
JIRAKAFKA-4393
WikiView on Apache Wiki
Created2016-11-18
Last Modified2016-12-02
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.