conduktor.io ↗

Kafka Exception SchemaBuilderException

org.apache.kafka.connect.errors.SchemaBuilderException
Non-retriable Connect

Indicates an error while building a schema via SchemaBuilder

Common Causes

Solutions

Example Stack Trace

org.apache.kafka.connect.errors.SchemaBuilderException: Cannot create field because of field name duplication __dbz__physicalTableIdentifier at org.apache.kafka.connect.data.SchemaBuilder.field(SchemaBuilder.java:347) at io.debezium.transforms.ByLogicalTableRouter.updateKeySchema(ByLogicalTableRouter.java:289) at io.debezium.transforms.ByLogicalTableRouter.apply(ByLogicalTableRouter.java:212) at org.apache.kafka.connect.runtime.TransformationChain.apply(TransformationChain.java:50) at org.apache.kafka.connect.runtime.WorkerSourceTask.convertTransformedRecord(WorkerSourceTask.java:290)

Diagnostic Commands

curl -s http://localhost:8083/connectors/<name>/config | jq '.config | with_entries(select(.key|startswith("transforms")))' # inspect the SMT chain for duplicate/chained routers curl -s http://localhost:8083/connectors/<name>/status | jq '.tasks[].trace' # read the full stack trace incl. the duplicated field name

Related

Related Connect exceptions: AlreadyExistsException · ConnectException · DataException · IllegalWorkerStateException · NotFoundException · SchemaProjectorException

Hitting SchemaBuilderException in production? Conduktor Console gives you real-time visibility into clients, consumer groups, and broker health. Browse every Kafka exception or protocol error code.