KIP-1183 — Unified Shared Storage

Discussion Tiered StorageBroker

Proposes a unified log layer for Apache Kafka that supports both local replication-based storage and cloud shared storage (block, file, object) simultaneously, making Kafka stateless and removing the need for ISR replication when running on durable shared storage. Kafka's ISR replication was designed for local disks and duplicates durability guarantees already provided by cloud shared storage services, wasting resources and preventing stateless elasticity.

Details