conduktor.io ↗

KIP-956 — Tiered Storage Quotas

Accepted Kafka 3.9 Tiered Storage

Introduces configurable bandwidth quotas for the Remote Log Manager (RLM) upload and fetch paths in Tiered Storage to bound the CPU and network impact of segment uploads. When Tiered Storage is enabled on existing large topics, the RLM schedules concurrent upload tasks for all eligible segments simultaneously, consuming significant CPU and degrading producer latencies.

Details

AuthorAbhijeet Kumar
StatusAccepted
Kafka Version3.9
JIRAKAFKA-15265
WikiView on Apache Wiki
Created2023-07-21
Last Modified2024-08-11
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.