conduktor.io ↗

KIP-303 — Add Dynamic Routing in Streams Sink

Accepted Kafka 2.0 Streams

Adds a TopicNameExtractor interface to the Kafka Streams DSL's to() sink operator, allowing the output topic name to be computed dynamically per-record from the record's key, value, and headers at runtime. All Streams topologies required output topic names to be known at topology build time, making it impossible to route records to dynamically chosen topics based on message content.

Details

AuthorGuozhang Wang
StatusAccepted
Kafka Version2.0
JIRAKAFKA-4936
WikiView on Apache Wiki
Created2018-05-15
Last Modified2018-05-25
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.