conduktor.io ↗

KIP-1003 — Signal next segment when remote fetching

Discussion Tiered Storage

Extends RemoteStorageManager#fetchLogSegment with an optional nextRemoteLogSegmentMetadata parameter, allowing RSM implementations to begin pre-fetching the next segment before the current one is fully consumed. Without segment boundary signaling, RSM pre-fetching was limited to within the current segment, causing latency spikes at segment transitions during sequential remote reads.

Details

AuthorJorge Esteban Quilcate Otoya
StatusDiscussion
JIRAKAFKA-15806
WikiView on Apache Wiki
Created2023-11-10
Last Modified2023-11-10
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.