KIP-516 — Topic Identifiers & Topic Deletion State Improvements

Accepted Kafka 4.1 ProtocolBroker

Assigns a unique `Uuid` (topic ID) to each topic at creation time, propagates it in metadata responses and fetch requests, and uses it to disambiguate stale vs. current topic replicas after delete-and-recreate operations. Identifying topics solely by name causes race conditions when a topic is deleted and recreated with the same name: brokers that were offline during deletion continue to serve stale data under the recycled name.

Protocol Impact

Produce v13 · Fetch v13 · Metadata · LeaderAndIsr · StopReplica · UpdateMetadata · OffsetCommit · CreateTopics · DeleteTopics · DeleteRecords · AddPartitionsToTxn · TxnOffsetCommit · DescribeConfigs · AlterConfigs · AlterReplicaLogDirs · DescribeLogDirs · CreatePartitions · Vote · BeginQuorumEpoch · EndQuorumEpoch

Details