KIP-426 — Persist Broker Id to Zookeeper

Discussion Broker

Proposes persisting auto-generated broker IDs to ZooKeeper in addition to the local meta.properties file, so a broker that loses its disk can recover its original ID on restart. In large clusters with frequent disk failures, losing the meta.properties file causes a broker to generate a new ID, creating ghost entries in ZooKeeper and requiring manual cleanup.

Details