KIP-207 — Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change

Accepted Kafka 2.2 BrokerProtocol

KIP-207 changes the new partition leader to refuse `ListOffsets` requests for a partition until its high watermark has caught up to its own log-end offset at the time of election, returning a retriable `LeaderNotAvailableException` (or a new precise error code in newer protocol versions) during that brief window. After a leader election, the new leader's HWM may be behind the old leader's HWM, causing `ListOffsets` to return a lower offset than before the election, breaking the monotonicity assumption that consumers and connectors (e.g. Spark Streaming) rely on.

Protocol Impact

ListOffsets

Details