KIP-925 — Rack aware task assignment in Kafka Streams
Accepted Kafka 3.6 Streams
Adds rack-aware task assignment to Kafka Streams' HighAvailabilityTaskAssignor by preferring to assign StreamTasks to Streams clients located in the same rack as the TopicPartition replicas they need to read. Without rack awareness, Streams tasks could be assigned to instances in a different availability zone than the partition leader, incurring cross-rack network costs and higher fetch latency.
Details
| Author | Hao Li |
| Status | Accepted |
| Kafka Version | 3.6 |
| JIRA | KAFKA-15022 |
| Wiki | View on Apache Wiki |
| Created | 2023-05-08 |
| Last Modified | 2024-05-20 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.