conduktor.io ↗

KIP-131 — Add access to OffsetStorageReader from SourceConnector

Accepted Kafka 2.6 Connect

Exposes an `OffsetStorageReader` to `SourceConnector` (not just `SourceTask`) so connector implementations can read committed source offsets in the `Connector` class itself. Without this, a `SourceConnector` background thread that scans for new source data (e.g. new files) cannot determine which files have already been fully processed, preventing task reconfiguration based on offset state.

Details

AuthorFlorian Hussonnois
StatusAccepted
Kafka Version2.6
JIRAKAFKA-4794
WikiView on Apache Wiki
Created2017-03-07
Last Modified2020-05-04
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.