KIP-678 — New Kafka Connect SMT for plainText => Struct(or Map) with Regex
Discussion Connect
Adds ExtractField SMT (ParseStructByRegex) that parses a plain-text record key or value using a named regex group pattern and maps captures to a Struct or Map with user-specified field names. No built-in SMT could transform unstructured text (access logs, URLs, delimited strings) into a typed Struct without a custom connector implementation.
Details
| Author | whsoul82 |
| Status | Discussion |
| JIRA | KAFKA-9436 |
| Wiki | View on Apache Wiki |
| Created | 2020-10-23 |
| Last Modified | 2022-09-02 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.