conduktor.io ↗

KIP-390 — Support Compression Level

Accepted Kafka 3.8 ProducerBroker

Adds per-codec compression level configuration (`compression.gzip.level`, `compression.lz4.level`, `compression.zstd.level`) at the producer, broker, and topic levels. Kafka's fixed default compression level is a suboptimal trade-off for many workloads; some use cases prioritize smaller compressed size (higher level) while others prioritize CPU throughput (lower level), and the choice can yield up to 156% more messages/sec in benchmarks.

Details

AuthorDongjin Lee
StatusAccepted
Kafka Version3.8
JIRAKAFKA-7632
WikiView on Apache Wiki
Created2018-11-18
Last Modified2024-05-21
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.