KIP-318 — Make Kafka Connect Source idempotent
Discussion Kafka 3.2 ConnectTransactions
Enables idempotent producers in Kafka Connect Source connectors by enabling `enable.idempotence=true` so that at-least-once delivery from sources is automatically deduplicated by the broker. Connect sources already configured `acks=all` and `max.in.flight.requests.per.connection=1` but did not activate the idempotent producer, leaving duplicate records possible on retries.
Details
| Author | Stephane Maarek |
| Status | Discussion |
| Kafka Version | 3.2 |
| JIRA | KAFKA-7077 |
| Wiki | View on Apache Wiki |
| Created | 2018-06-20 |
| Last Modified | 2022-03-18 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.