conduktor.io ↗

KIP-618 — Exactly-Once Support for Source Connectors

Accepted Kafka 3.2 ConnectTransactions

Adds exactly-once delivery support for Kafka Connect source connectors by writing source records and their offsets atomically within a Kafka transaction, using the transactional producer API. Without EoS, source connector offsets are committed separately from the records they correspond to, creating a window where records can be duplicated on Connect worker restart.

Details

AuthorChris Egerton
StatusAccepted
Kafka Version3.2
JIRAKAFKA-10000
WikiView on Apache Wiki
Created2020-05-16
Last Modified2023-06-07
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.