KIP-1040 — Improve handling of nullable values in InsertField, ExtractField, and other transformations
Accepted Kafka 3.9 Connect
Fixes several Kafka Connect SMTs (InsertField, ExtractField, SetSchemaMetadata, and others) to correctly propagate null field values when the JsonConverter is configured with replace.null.with.default=false. The SMT implementations created copies of Struct objects through internal paths that unconditionally substituted field defaults for null values, overriding the converter's explicit null-preservation setting.
Details
| Author | Mickael Maison |
| Status | Accepted |
| Kafka Version | 3.9 |
| JIRA | KAFKA-15838 |
| Wiki | View on Apache Wiki |
| Created | 2024-04-26 |
| Last Modified | 2024-06-25 |
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.