KIP-618 — Exactly-Once Support for Source Connectors
Accepted Kafka 3.2 ConnectTransactions
Adds exactly-once delivery support for Kafka Connect source connectors by writing source records and their offsets atomically within a Kafka transaction, using the transactional producer API. Without EoS, source connector offsets are committed separately from the records they correspond to, creating a window where records can be duplicated on Connect worker restart.
Details
| Author | Chris Egerton |
| Status | Accepted |
| Kafka Version | 3.2 |
| JIRA | KAFKA-10000 |
| Wiki | View on Apache Wiki |
| Created | 2020-05-16 |
| Last Modified | 2023-06-07 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.