conduktor.io ↗

KIP-758 — Remove list of latest producer append information for broker

Discussion BrokerProducer

Reduces the per-producer-per-partition append cache in brokers from storing the 5 most recent batch writes to storing only the 1 most recent, reducing memory consumption. The per-PID append cache is used to deduplicate retried produce requests; storing 5 entries per PID per partition causes OOM in production clusters with many producers.

Details

AuthorYi Ding
StatusDiscussion
JIRAKAFKA-12207
WikiView on Apache Wiki
Created2021-06-23
Last Modified2021-08-24
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.