KIP-758 — Remove list of latest producer append information for broker
Discussion BrokerProducer
Reduces the per-producer-per-partition append cache in brokers from storing the 5 most recent batch writes to storing only the 1 most recent, reducing memory consumption. The per-PID append cache is used to deduplicate retried produce requests; storing 5 entries per PID per partition causes OOM in production clusters with many producers.
Details
| Author | Yi Ding |
| Status | Discussion |
| JIRA | KAFKA-12207 |
| Wiki | View on Apache Wiki |
| Created | 2021-06-23 |
| Last Modified | 2021-08-24 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.