conduktor.io ↗

KIP-678 — New Kafka Connect SMT for plainText => Struct(or Map) with Regex

Discussion Connect

Adds ExtractField SMT (ParseStructByRegex) that parses a plain-text record key or value using a named regex group pattern and maps captures to a Struct or Map with user-specified field names. No built-in SMT could transform unstructured text (access logs, URLs, delimited strings) into a typed Struct without a custom connector implementation.

Details

Authorwhsoul82
StatusDiscussion
JIRAKAFKA-9436
WikiView on Apache Wiki
Created2020-10-23
Last Modified2022-09-02
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.