conduktor.io ↗

KIP-215 — Add topic regex support for Connect sinks

Accepted Kafka 1.1 Connect

Adds a `topics.regex` configuration option to Connect sink connectors allowing them to subscribe to a dynamic set of topics via a Java regex pattern, in addition to the existing static `topics` list. Connect sinks hardcoded to a topic list require connector reconfiguration (and a rebalance) whenever new matching topics are created, making dynamic topic consumption impossible.

Details

AuthorJeff Klukas
StatusAccepted
Kafka Version1.1
JIRAKAFKA-3073
WikiView on Apache Wiki
Created2017-10-27
Last Modified2018-01-08
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.