log.cleaner.min.cleanable.ratio — Kafka Broker Configuration
The minimum ratio of dirty log to total log for a log to eligible for cleaning. If the log.
Description
The minimum ratio of dirty log to total log for a log to eligible for cleaning. If the log.cleaner.max.compaction.lag.ms or the log.cleaner.min.compaction.lag.ms configurations are also specified, then the log compactor considers the log eligible for compaction as soon as either: (i) the dirty ratio threshold has been met and the log has had dirty (uncompacted) records for at least the log.cleaner.min.compaction.lag.ms duration, or (ii) if the log has had dirty (uncompacted) records for at most the log.cleaner.max.compaction.lag.ms period.
Default Values by Kafka Version
| Kafka Version | Default Value |
|---|---|
| 0.8.1 | 0.5 |
| 0.8.2 | 0.5 |
| 0.9.0 | 0.5 |
| 0.10.0 | 0.5 |
| 0.10.1 | 0.5 |
| 0.10.2 | 0.5 |
| 0.11.0 | 0.5 |
| 1.0 | 0.5 |
| 1.1 | 0.5 |
| 2.0 | 0.5 |
| 2.1 | 0.5 |
| 2.2 | 0.5 |
| 2.3 | 0.5 |
| 2.4 | 0.5 |
| 2.5 | 0.5 |
| 2.6 | 0.5 |
| 2.7 | 0.5 |
| 2.8 | 0.5 |
| 3.0 | 0.5 |
| 3.1 | 0.5 |
| 3.2 | 0.5 |
| 3.3 | 0.5 |
| 3.4 | 0.5 |
| 3.5 | 0.5 |
| 3.6 | 0.5 |
| 3.7 | 0.5 |
| 3.8 | 0.5 |
| 3.9 | 0.5 |
| 4.0 | 0.5 |
| 4.1 | 0.5 |
| 4.2 | 0.5 |
Tuning Recommendation
| Profile | Recommended | Why |
|---|---|---|
| broker / cost | 0.3 | A partition is eligible for compaction when its dirty (uncompacted) bytes exceed this fraction of total log bytes. Lowering from 0.5 to 0.3 triggers compaction earlier, keeping the log more aggressively compacted at the cost of more frequent cleaner cycles. |
Related Configs
log.cleaner.threads · log.cleanup.policy · log.cleaner.dedupe.buffer.size
Manage Kafka configs across all your clusters with Conduktor Console — view, compare, and update configurations in one place.