conduktor.io ↗

Kafka 3.2 → 3.3 Upgrade Guide

Kafka 3.3 brings 11 new configs, removes 0, and changes 11 defaults compared to 3.2.

+11 configs 11 defaults changed 14 KIPs

New Configurations

ConfigCategoryDefault
early.start.listenersbrokernull
metadata.max.idle.interval.msbroker500
sasl.server.max.receive.sizebroker524288
partitioner.adaptive.partitioning.enableproducertrue
partitioner.availability.timeout.msproducer0
partitioner.ignore.keysproducerfalse
exactly.once.source.supportconnect_defaultdisabled
exactly.once.supportconnect_sourcerequested
offsets.storage.topicconnect_sourcenull
transaction.boundaryconnect_sourcepoll
transaction.boundary.interval.msconnect_sourcenull

Changed Defaults

ConfigOld DefaultNew Default
inter.broker.protocol.version3.2-IV03.3-IV3
ssl.enabled.protocolsTLSv1.2TLSv1.2,TLSv1.3
ssl.protocolTLSv1.2TLSv1.3
ssl.enabled.protocolsTLSv1.2TLSv1.2,TLSv1.3
ssl.protocolTLSv1.2TLSv1.3
partitioner.classorg.apache.kafka.clients.producer.internals.DefaultPartitionernull
ssl.enabled.protocolsTLSv1.2TLSv1.2,TLSv1.3
ssl.protocolTLSv1.2TLSv1.3
ssl.enabled.protocolsTLSv1.2TLSv1.2,TLSv1.3
ssl.protocolTLSv1.2TLSv1.3
state.dir/var/folders/ds/dq10m26j2kjcypywn_lt0b0m0000gn/T//kafka-streams/var/folders/8t/s723rqwx1h78qt3w98cp_gsm0000gp/T//kafka-streams

Protocol Changes

DescribeAcls v3 · DescribeAcls v3 · CreateAcls v3 · CreateAcls v3 · DeleteAcls v3 · DeleteAcls v3 · DescribeLogDirs v4 · DescribeLogDirs v4 · CreateDelegationToken v3 · CreateDelegationToken v3 · DescribeDelegationToken v3 · DescribeDelegationToken v3 · DescribeQuorum v1 · DescribeQuorum v1 · UpdateFeatures v1 · UpdateFeatures v1

KIPs Released

KIP-373 Allow users to create delegation tokens for other users
KIP-778 KRaft to KRaft Upgrades
KIP-794 Strictly Uniform Sticky Partitioner
KIP-820 Extend KStream process with new Processor API
KIP-824 Allowing dumping segmentlogs limiting the batches in the output
KIP-827 Expose logdirs total and usable space via Kafka API
KIP-828 Add the corresponding validator to the configuration where the validator is missing
KIP-831 Add metric for log recovery progress
KIP-835 Monitor KRaft Controller Quorum Health
KIP-836 Expose replication information of the cluster metadata
KIP-841 Fenced replicas should not be allowed to join the ISR in KRaft
KIP-843 Adding addMetricIfAbsent method to Metrics
KIP-851 Add requireStable flag into ListConsumerGroupOffsetsOptions
KIP-859 Add Metadata Log Processing Error Related Metrics
Planning a Kafka upgrade? Conduktor Console helps you manage and monitor your clusters during migration.