conduktor.io ↗

KIP-656 — MirrorMaker2 Exactly-once Semantics

Discussion Kafka 3.5 MirrorMakerTransactions

Adds an optional exactly-once semantics (EOS) mode to MirrorMaker 2 by implementing a `MirrorSinkTask` that manages consumer offsets transactionally, ensuring each record is delivered to the target cluster exactly once. MirrorMaker 2 is built on Kafka Connect's source connector framework, which provides only at-least-once delivery, meaning duplicate records can be produced to target clusters on task restarts.

Details

AuthorNing Zhang
StatusDiscussion
Kafka Version3.5
JIRAKAFKA-10339
WikiView on Apache Wiki
Created2020-08-03
Last Modified2020-11-26
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.