conduktor.io ↗

KIP-647 — Add ability to handle late messages in streams-aggregation

Discussion Streams

Adds an overloaded `aggregate()` method to `TimeWindowedKStream` that accepts a `lateMessagesTopicName` parameter to route records arriving after the aggregation window (including grace period) has closed to a designated topic instead of silently dropping them. Currently late messages in windowed aggregations are silently dropped with a warning log, with no way for applications to inspect or reprocess them.

Details

AuthorIgor Piddubnyi
StatusDiscussion
JIRAKAFKA-8582
WikiView on Apache Wiki
Created2020-07-24
Last Modified2020-07-24
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.