conduktor.io ↗

KIP-154 — Add Kafka Connect configuration properties for creating internal topics

Accepted Kafka 1.0 Connect

Adds `offset.storage.*`, `config.storage.*`, and `status.storage.*` config prefixes to Kafka Connect `WorkerConfig`, allowing operators to set replication factor, cleanup policy, compaction settings, and other topic configs for the three internal Connect topics. Previously, internal topic creation used hardcoded defaults (replication.factor=1 for offsets, etc.), making production deployments with replication impossible without manual topic pre-creation.

Details

AuthorRandall Hauch
StatusAccepted
Kafka Version1.0
JIRAKAFKA-4667
WikiView on Apache Wiki
Created2017-05-05
Last Modified2017-05-18
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.