KIP-1248 — Broker support for remote tiered storage fetch from consumer

Discussion Tiered StorageConsumer

Adds broker-side protocol support for redirecting consumer fetch requests to remote tiered storage (e.g., S3) when the requested offsets are only available remotely. Currently, brokers download remote segments to local disk and re-serve them to consumers (double-hop), consuming broker disk I/O and network bandwidth; direct consumer fetch eliminates the broker as an intermediary for cold reads.

Protocol Impact

Fetch · ShareFetch

Details