conduktor.io ↗

remote.log.manager.copy.max.bytes.per.second — Kafka Broker Configuration

The maximum number of bytes that can be copied from local storage to remote storage per second. This is a global limit for all the partitions that are being copied from local storage to remote storage.

Description

The maximum number of bytes that can be copied from local storage to remote storage per second. This is a global limit for all the partitions that are being copied from local storage to remote storage. The default value is Long.MAX_VALUE, which means there is no limit on the number of bytes that can be copied per second.

Default Values by Kafka Version

Kafka VersionDefault Value
3.89223372036854775807
3.99223372036854775807
4.09223372036854775807
4.19223372036854775807
4.29223372036854775807

Tuning Recommendation

ProfileRecommendedWhy
broker / cost52428800Throttles remote copy to 50MB/s per broker to prevent tiered storage uploads from saturating network bandwidth and impacting live produce/fetch traffic.

Related Configs

remote.log.manager.copier.thread.pool.size · remote.log.storage.system.enable · remote.log.manager.thread.pool.size

Manage Kafka configs across all your clusters with Conduktor Console — view, compare, and update configurations in one place.