KIP-779 — Allow Source Tasks to Handle Producer Exceptions
Accepted Kafka 3.2 Connect
Adds a new `SourceTask.commitRecord(SourceRecord, RecordMetadata)` callback and error handling hook so source connectors can handle producer exceptions (e.g., record-too-large) per record rather than having the task killed. Previously, any producer write failure from a source task immediately killed the connector with no opportunity for the connector to log, route to a DLQ, or skip the bad record.
Details
| Author | Knowles Atchison Jr |
| Status | Accepted |
| Kafka Version | 3.2 |
| JIRA | KAFKA-13348 |
| Wiki | View on Apache Wiki |
| Created | 2021-10-05 |
| Last Modified | 2021-11-29 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.