KIP-178 — Size-based log directory selection strategy
Discussion Broker
Adds a broker-side log directory selection strategy setting with two modes: `partition`, the existing heuristic that picks the `log.dirs` entry holding the fewest partitions, and `size`, which reads real free space through Java `File.getFreeSpace()` and picks the emptiest directory, falling back to partition counts when a `SecurityException` is raised. Partition-count placement distributes data poorly when partition volumes are uneven, so in production some log directories run nearly full while others keep large amounts of unused space.
Details
| Author | huxihx |
| Status | Discussion |
| JIRA | KAFKA-5560 |
| Wiki | View on Apache Wiki |
| Created | 2017-07-18 |
| Last Modified | 2017-07-19 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.