conduktor.io ↗

KIP-572 — Improve timeouts and retries in Kafka Streams

Accepted Kafka 2.8 Streams

Introduces a dedicated `task.timeout.ms` configuration for Kafka Streams that causes a task to fail (rather than block indefinitely) when a single operation exceeds the timeout, decoupling Streams-level timeout handling from the embedded client retry behavior. Previously Streams relied entirely on internal Kafka client retries, which blocked the entire `StreamThread` for all tasks when one client retried, and gave users no control over the overall operation timeout.

Details

AuthorMatthias J. Sax
StatusAccepted
Kafka Version2.8
JIRAKAFKA-9274
WikiView on Apache Wiki
Created2020-02-19
Last Modified2021-02-19
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.