KIP-870 — Retention policy based on record event time

Discussion Broker

Proposes adding retention.max.eventtime.ms, a new retention policy that truncates log segments once the maximum event timestamp in the segment exceeds the configured age, independent of broker wall-clock time. Existing time-based retention compares append time to wall clock, which aggressively deletes data during reprocessing scenarios when Kafka Streams re-ingests old events.

Details