KIP-110 — Add Codec for ZStandard Compression

Accepted Kafka 2.2 ProducerBroker

Adds Zstandard (zstd) as a supported compression codec for Kafka message batches. Zstd offers significantly better compression ratios than LZ4/Snappy at comparable or faster speeds, and major big data frameworks (Hadoop, Spark, HBase) had already adopted it, making its absence a gap for Kafka deployments that prioritize storage efficiency.

Protocol Impact

Produce v7 · Fetch v10

Details