conduktor.io ↗

KIP-28 — Add a processor client

Accepted Kafka 1.0 StreamsClient

Adds a Kafka processor client library that lets applications express stream transformations on top of the producer and consumer while the client manages multi-threading and parallelism, partition assignment, journaled local state storage, and offset commits. Writing transformations with the raw producer and consumer APIs is too low-level once the logic stops being trivial, while full frameworks such as Storm, Samza, Spark Streaming or Flink integrate poorly with Kafka and are heavy-weight to deploy for simple topologies.

Details

AuthorGuozhang Wang
StatusAccepted
Kafka Version1.0
WikiView on Apache Wiki
Created2015-07-24
Last Modified2016-02-10
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.