conduktor.io ↗

KIP-1105 — Make remote log manager thread-pool configs dynamic

Accepted Kafka 4.0 Tiered Storage

Makes the `RemoteLogManager` thread pool sizes (`remote.log.manager.copier.thread.pool.size`, `remote.log.manager.expiration.thread.pool.size`, `remote.log.reader.threads`) dynamically reconfigurable without broker restart. Under variable tiered storage load, operators need to tune concurrency at runtime to avoid backlogs or over-provisioning.

Details

AuthorKamal Chandraprakash
StatusAccepted
Kafka Version4.0
JIRAKAFKA-17928
WikiView on Apache Wiki
Created2024-11-03
Last Modified2024-11-12
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.