conduktor.io ↗

KIP-619 — Add internal topic creation support

Discussion ProtocolBroker

Introduces a mechanism for Kafka clients to register their own internal topics with the broker via a new `RegisterClientMetrics` RPC so that the broker's `MetadataResponse` can correctly mark those topics as internal. Broker-side internal topic detection relied on a hardcoded list (`__consumer_offsets`, `__transaction_state`), so client-defined internal topics like Connect's `connect-configs` were not recognized as internal by the broker and could be incorrectly exposed.

Protocol Impact

Metadata · UpdateMetadata

Details

AuthorCheng Tan
StatusDiscussion
WikiView on Apache Wiki
Created2020-05-28
Last Modified2020-08-19
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.