conduktor.io ↗

KIP-1173 — Connect Storage Topics Sharing Across Clusters

Discussion Connect

Proposes allowing multiple Kafka Connect clusters to share a single set of internal storage topics (offset, status, config) rather than requiring three dedicated topics per cluster. Each new Connect cluster requires three compacted topics, leading to topic proliferation, cross-team provisioning bottlenecks, and excessive compaction overhead as deployment scale grows.

Details

AuthorPritam Kumar Mishra
StatusDiscussion
JIRAKAFKA-19211
WikiView on Apache Wiki
Created2025-04-27
Last Modified2025-04-28
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.