KIP-1158 — Improve Connect SourceTask commit()
Discussion Connect
Proposes extending SourceTask with a commit(Map offsets) hook that receives the specific offsets being committed, enabling source connectors to know exactly which records are durably committed to Kafka before signaling progress to the external source system. The existing commit() hook fires periodically but without the committed offset values, and commitRecord() fires per-record but without strict ordering guarantees or batch-level completion signals.
Details
| Author | Sudesh Wasnik |
| Status | Discussion |
| JIRA | KAFKA-19106 |
| Wiki | View on Apache Wiki |
| Created | 2025-04-07 |
| Last Modified | 2025-04-15 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.