conduktor.io ↗

KIP-150 — Kafka-Streams Cogroup

Accepted Kafka 2.5 Streams

KIP-150 introduces the `CogroupedKStream` API to the Kafka Streams DSL, allowing multiple input streams to be co-grouped and aggregated into a single KTable using a single shared state store per key space. Without co-grouping, combining N streams into a single aggregate requires N intermediate KTables each with its own state store plus a chain of outer joins, creating high state amplification and complex topologies.

Details

AuthorKyle Winkelman
StatusAccepted
Kafka Version2.5
JIRAKAFKA-6049
WikiView on Apache Wiki
Created2017-05-01
Last Modified2019-10-29
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.