conduktor.io ↗

KIP-178 — Size-based log directory selection strategy

Discussion Broker

Adds a broker-side log directory selection strategy setting with two modes: `partition`, the existing heuristic that picks the `log.dirs` entry holding the fewest partitions, and `size`, which reads real free space through Java `File.getFreeSpace()` and picks the emptiest directory, falling back to partition counts when a `SecurityException` is raised. Partition-count placement distributes data poorly when partition volumes are uneven, so in production some log directories run nearly full while others keep large amounts of unused space.

Details

Authorhuxihx
StatusDiscussion
JIRAKAFKA-5560
WikiView on Apache Wiki
Created2017-07-18
Last Modified2017-07-19
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.