KIP-936 — Throttle number of active PIDs

Discussion BrokerTransactions

KIP-936 proposes a configurable cap on the maximum number of active producer IDs (PIDs) tracked by `ProducerStateManager` per broker, with throttling or rejection when the limit is reached. Since KIP-679 made idempotent producers the default, every producer instance is assigned a PID; a large number of short-lived or restarting producers can cause `ProducerStateManager` to accumulate unbounded in-memory state, risking OOM errors.

Protocol Impact

Produce

Details