conduktor.io ↗

KIP-712 — Shallow Mirroring

Discussion MirrorMaker

Proposes a zero-copy MirrorMaker path that transfers raw record batches from source to destination broker without deserializing/re-serializing individual records ('shallow mirroring'). The current MirrorMaker pipeline copies bytes multiple times: from the network buffer into `ConsumerRecord`, then from `ConsumerRecord` into `ProducerRecord`, each requiring full deserialization and re-serialization of record batches.

Protocol Impact

Produce · Fetch

Details

AuthorHenry Cai
StatusDiscussion
JIRAKAFKA-12295
WikiView on Apache Wiki
Created2021-02-04
Last Modified2021-02-05
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.