conduktor.io ↗

KIP-779 — Allow Source Tasks to Handle Producer Exceptions

Accepted Kafka 3.2 Connect

Adds a new `SourceTask.commitRecord(SourceRecord, RecordMetadata)` callback and error handling hook so source connectors can handle producer exceptions (e.g., record-too-large) per record rather than having the task killed. Previously, any producer write failure from a source task immediately killed the connector with no opportunity for the connector to log, route to a DLQ, or skip the bad record.

Details

AuthorKnowles Atchison Jr
StatusAccepted
Kafka Version3.2
JIRAKAFKA-13348
WikiView on Apache Wiki
Created2021-10-05
Last Modified2021-11-29
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.