conduktor.io ↗

num.recovery.threads.per.data.dir — Kafka Broker Configuration

The number of threads per data directory to be used for log recovery at startup and flushing at shutdown.

Description

The number of threads per data directory to be used for log recovery at startup and flushing at shutdown

Default Values by Kafka Version

Kafka VersionDefault Value
0.8.21
0.9.01
0.10.01
0.10.11
0.10.21
0.11.01
1.01
1.11
2.01
2.11
2.21
2.31
2.41
2.51
2.61
2.71
2.81
3.01
3.11
3.21
3.31
3.41
3.51
3.61
3.71
3.81
3.91
4.02
4.12
4.22

Tuning Recommendation

ProfileRecommendedWhy
broker / throughput4Doubles log recovery threads from 2 to 4 per data directory, parallelizing startup recovery and shutdown flushing. With thousands of partitions per data dir, 2 threads can bottleneck broker restart time.

Related Configs

num.io.threads

Manage Kafka configs across all your clusters with Conduktor Console — view, compare, and update configurations in one place.