KIP-1259 — Add configuration to wipe Kafka Streams local state on startup

Accepted Kafka 4.3 Streams

Adds a startup configuration flag (state.dir.wipe.on.startup or equivalent) that causes Kafka Streams to delete all local state store data and checkpoint files before restoring from changelogs. A zombie-data edge case occurs when an instance restarts with stale local state after the changelog's delete.retention.ms has expired: the local checkpoint offset still exists on the broker but the corresponding changelog records have been deleted, causing silent state corruption on restore.

Details