conduktor.io ↗

KIP-925 — Rack aware task assignment in Kafka Streams

Accepted Kafka 3.6 Streams

Adds rack-aware task assignment to Kafka Streams' HighAvailabilityTaskAssignor by preferring to assign StreamTasks to Streams clients located in the same rack as the TopicPartition replicas they need to read. Without rack awareness, Streams tasks could be assigned to instances in a different availability zone than the partition leader, incurring cross-rack network costs and higher fetch latency.

Details

AuthorHao Li
StatusAccepted
Kafka Version3.6
JIRAKAFKA-15022
WikiView on Apache Wiki
Created2023-05-08
Last Modified2024-05-20
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.