KIP-1105 — Make remote log manager thread-pool configs dynamic
Accepted Kafka 4.0 Tiered Storage
Makes the `RemoteLogManager` thread pool sizes (`remote.log.manager.copier.thread.pool.size`, `remote.log.manager.expiration.thread.pool.size`, `remote.log.reader.threads`) dynamically reconfigurable without broker restart. Under variable tiered storage load, operators need to tune concurrency at runtime to avoid backlogs or over-provisioning.
Details
| Author | Kamal Chandraprakash |
| Status | Accepted |
| Kafka Version | 4.0 |
| JIRA | KAFKA-17928 |
| Wiki | View on Apache Wiki |
| Created | 2024-11-03 |
| Last Modified | 2024-11-12 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.