conduktor.io ↗

KIP-1002 — Fetch remote segment indexes at once

Discussion Tiered Storage

Adds a `RemoteStorageManager.fetchLogSegmentData(metadata, indexes)` batch API to retrieve all segment indexes (offset, time, transaction, leader epoch) in a single remote storage call alongside the log data. Currently each index type is fetched with a separate `fetchIndex()` call, multiplying remote storage round-trips per consumer fetch.

Details

AuthorJorge Esteban Quilcate Otoya
StatusDiscussion
JIRAKAFKA-15805
WikiView on Apache Wiki
Created2023-11-10
Last Modified2023-11-13
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.