conduktor.io ↗

partitioner.adaptive.partitioning.enable — Kafka Producer Configuration

When set to 'true', the producer will try to adapt to broker performance and produce more messages to partitions hosted on faster brokers. If 'false', producer will try to distribute messages uniformly.

Description

When set to 'true', the producer will try to adapt to broker performance and produce more messages to partitions hosted on faster brokers. If 'false', producer will try to distribute messages uniformly. Note: this setting has no effect if a custom partitioner is used

Default Values by Kafka Version

Kafka VersionDefault Value
3.3true
3.4true
3.5true
3.6true
3.7true
3.8true
3.9true
4.0true
4.1true
4.2true

Tuning Recommendation

ProfileRecommendedWhy
producer / throughputtrueKeep adaptive partitioning enabled (default since 3.3): it routes batches away from slow/overloaded partitions using real-time queue depth, improving sustained throughput by 10-30% on heterogeneous clusters.

Related Configs

partitioner.class · partitioner.ignore.keys · partitioner.availability.timeout.ms

Manage Kafka configs across all your clusters with Conduktor Console — view, compare, and update configurations in one place.