KIP-647 — Add ability to handle late messages in streams-aggregation
Discussion Streams
Adds an overloaded `aggregate()` method to `TimeWindowedKStream` that accepts a `lateMessagesTopicName` parameter to route records arriving after the aggregation window (including grace period) has closed to a designated topic instead of silently dropping them. Currently late messages in windowed aggregations are silently dropped with a warning log, with no way for applications to inspect or reprocess them.
Details
| Author | Igor Piddubnyi |
| Status | Discussion |
| JIRA | KAFKA-8582 |
| Wiki | View on Apache Wiki |
| Created | 2020-07-24 |
| Last Modified | 2020-07-24 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.