KIP-1282 — Prevent data loss during partition expansion for dynamically added partitions

Discussion ConsumerBroker

Introduces a new auto.offset.reset policy called partition-start that resets consumers to the beginning of only newly discovered partitions while continuing from committed offsets on existing ones. The existing earliest policy forces full historical replay and latest silently drops messages produced between partition discovery and consumer assignment—neither is safe during partition expansion or initial consumer startup.

Protocol Impact

ListOffsets · Heartbeat · ConsumerGroupHeartbeat

Details