conduktor.io ↗

KIP-318 — Make Kafka Connect Source idempotent

Discussion Kafka 3.2 ConnectTransactions

Enables idempotent producers in Kafka Connect Source connectors by enabling `enable.idempotence=true` so that at-least-once delivery from sources is automatically deduplicated by the broker. Connect sources already configured `acks=all` and `max.in.flight.requests.per.connection=1` but did not activate the idempotent producer, leaving duplicate records possible on retries.

Details

AuthorStephane Maarek
StatusDiscussion
Kafka Version3.2
JIRAKAFKA-7077
WikiView on Apache Wiki
Created2018-06-20
Last Modified2022-03-18
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.