KIP-30 — Allow for brokers to have plug-able consensus and meta data storage sub systems

Discussion BrokerAdmin

KIP-30 proposes pluggable interfaces for the coordination subsystems Kafka delegates to ZooKeeper—group membership, leader election, distributed key-value storage, and data-change listeners—so alternative systems like etcd, Consul, or Cassandra can be used. This decouples Kafka from ZooKeeper's low-level primitives (ephemeral nodes, watches) which are a source of subtle correctness bugs.

Details