conduktor.io ↗

KIP-1241 — Reduce tiered storage redundancy with delayed upload

Discussion Tiered Storage

Adds a configurable delayed upload option for tiered storage, deferring segment upload to remote storage until the segment ages beyond a threshold relative to the local retention period. The current implementation eagerly uploads all closed segments to remote storage immediately, storing the same data on both local disk and remote object storage simultaneously and incurring unnecessary storage costs when data is still within its local retention window.

Details

Authorfu.jian
StatusDiscussion
JIRAKAFKA-19893
WikiView on Apache Wiki
Created2025-11-19
Last Modified2026-03-18
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.