conduktor.io ↗

KIP-167 — Add interface for the state store restoration process

Accepted Kafka 1.0 Streams

Adds a `StateRestoreListener` interface to Kafka Streams with callbacks for restoration start, progress, and completion, plus a bulk `restoreAll(Collection<KeyValue>)` method on `BatchingStateRestoreCallback` for stores that can optimize bulk writes (e.g., RocksDB's `WriteBatch`). State store restoration currently restores records one-by-one and provides no progress visibility, making recovery time unpredictable and RocksDB's efficient bulk write path unused.

Details

AuthorBill Bejeck
StatusAccepted
Kafka Version1.0
JIRAKAFKA-5363
WikiView on Apache Wiki
Created2017-06-01
Last Modified2017-09-28
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.