KIP-1003 — Signal next segment when remote fetching
Discussion Tiered Storage
Extends RemoteStorageManager#fetchLogSegment with an optional nextRemoteLogSegmentMetadata parameter, allowing RSM implementations to begin pre-fetching the next segment before the current one is fully consumed. Without segment boundary signaling, RSM pre-fetching was limited to within the current segment, causing latency spikes at segment transitions during sequential remote reads.
Details
| Author | Jorge Esteban Quilcate Otoya |
| Status | Discussion |
| JIRA | KAFKA-15806 |
| Wiki | View on Apache Wiki |
| Created | 2023-11-10 |
| Last Modified | 2023-11-10 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.