conduktor.io ↗

KIP-892 — Transactional Semantics for StateStores

Accepted StreamsTransactions

Introduces transactional semantics for RocksDB-backed Kafka Streams state stores, ensuring state is only persisted to disk once the corresponding changelog offset is durably committed, bounding state restore under EOS to under 1 second. Under the current design, state is written to the local store before changelog commits complete, so EOS crash recovery must replay the entire changelog from scratch, causing restore times proportional to changelog size that in production can span multiple days.

Details

AuthorNicholas Telford
StatusAccepted
JIRAKAFKA-14412
WikiView on Apache Wiki
Created2022-11-21
Last Modified2024-11-26
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.