KIP-311 — Async processing with dynamic scheduling in Kafka Streams

Discussion Streams

Proposes an asynchronous processing model in Kafka Streams with a dynamic thread scheduler so that tasks blocking on I/O (external REST calls, disk) do not block other tasks sharing the same stream thread. The current single-thread-per-task model serializes all processing, meaning one slow I/O call stalls the entire thread and its tasks. (KIP abandoned.)

Details