conduktor.io ↗

KIP-910 — Update Source offsets for Source Connectors without producing records

Discussion Connect

Adds a SourceTask#updateOffsets() method allowing source connectors to commit updated offsets to the Connect offset store without producing any records to Kafka. Without this, offsets only advance when records are produced, causing offset staleness during quiet periods in the source system and risking inability to resume from the correct position if the source purges its change log.

Details

AuthorSagar Rao
StatusDiscussion
JIRAKAFKA-3821
WikiView on Apache Wiki
Created2023-02-23
Last Modified2023-09-06
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.