conduktor.io ↗

KIP-1018 — Introduce max remote fetch timeout config for DelayedRemoteFetch requests

Accepted Kafka 3.8 Tiered StorageBroker

Adds a dedicated remote.fetch.max.wait.ms broker configuration for the DelayedRemoteFetchPurgatory timeout used when fetching from tiered (remote) storage, independent of the consumer's fetch.max.wait.ms. The shared fetch.max.wait.ms default (500ms) was too short for remote storage fetches during degraded conditions, causing excessive purgatory expiration and retry storms against the remote storage layer.

Details

AuthorKamal Chandraprakash
StatusAccepted
Kafka Version3.8
JIRAKAFKA-15776
WikiView on Apache Wiki
Created2024-01-30
Last Modified2024-06-05
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.