KIP-1123 — Rack-aware partitioning for Kafka Producer
Accepted Producer
Adds rack-aware (AZ-aware) partitioning to the Kafka producer: when client.rack is set, the producer preferentially routes to partitions whose leaders reside in the same AZ, reducing cross-AZ network traffic and latency. The default adaptive partitioner rotated across all partitions without rack awareness, causing producers to regularly send records cross-AZ and incur inter-AZ data transfer costs in cloud deployments.
Details
| Author | Ivan Yurchenko |
| Status | Accepted |
| JIRA | KAFKA-19193 |
| Wiki | View on Apache Wiki |
| Created | 2024-12-20 |
| Last Modified | 2025-05-19 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.