KIP-1272 — Support Compacted Topic in Tiered Storage

Discussion Tiered StorageBroker

Extends tiered storage (KIP-405) to support compacted topics by handling the semantics of compaction in remote object storage, including uploading compacted segments, tracking which keys have been compacted away, and serving offset lookups over compacted remote segments. KIP-405 only supports append-only (delete-retention) log segments; compacted topics are a fundamentally different retention model that requires tracking the latest value per key across both local and remote tiers.

Details