KIP-892 — Transactional Semantics for StateStores
Accepted StreamsTransactions
Introduces transactional semantics for RocksDB-backed Kafka Streams state stores, ensuring state is only persisted to disk once the corresponding changelog offset is durably committed, bounding state restore under EOS to under 1 second. Under the current design, state is written to the local store before changelog commits complete, so EOS crash recovery must replay the entire changelog from scratch, causing restore times proportional to changelog size that in production can span multiple days.
Details
| Author | Nicholas Telford |
| Status | Accepted |
| JIRA | KAFKA-14412 |
| Wiki | View on Apache Wiki |
| Created | 2022-11-21 |
| Last Modified | 2024-11-26 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.