KIP-1059 — Enable Producer to resolve send() method errors
Discussion Producer
Proposes extending Producer.send() with an error-handling callback that allows the caller to decide whether a per-record error (e.g., RecordTooLargeException) should abort the entire transaction or be skipped, enabling poison-pill tolerance in transactional Kafka Streams pipelines. In transactional producers, any send error currently forces an AbortTransaction, causing the entire batch to be dropped even when only a single bad record caused the failure.
Details
| Author | Alieh Saeedi |
| Status | Discussion |
| JIRA | KAFKA-15259 |
| Wiki | View on Apache Wiki |
| Created | 2024-06-17 |
| Last Modified | 2024-07-16 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.