conduktor.io ↗

KIP-416 — Notify SourceTask of ACK'd offsets, metadata

Discussion Kafka 2.4 Connect

Adds a callback to SourceTask notifying it of the downstream Kafka offsets after produced records are ACK'd by the broker. MirrorMaker 2 and other replication connectors need downstream offsets to implement cross-cluster offset translation, but WorkerSourceTask previously discarded this information.

Details

AuthorRyanne Dolan
StatusDiscussion
Kafka Version2.4
JIRAKAFKA-7815
WikiView on Apache Wiki
Created2018-12-15
Last Modified2019-10-05
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.