Kafka 3.3 → 3.4 Upgrade Guide

Kafka 3.4 brings 9 new configs, removes 0, and changes 11 defaults compared to 3.3.

+9 configs 11 defaults changed 6 KIPs

New Configurations

Config	Category	Default
auto.include.jmx.reporter	broker	true
metadata.log.max.snapshot.interval.ms	broker	3600000 (1 hour)
producer.id.expiration.ms	broker	86400000 (1 day)
zookeeper.metadata.migration.enable	broker	false
auto.include.jmx.reporter	consumer	true
auto.include.jmx.reporter	producer	true
auto.include.jmx.reporter	connect_default	true
auto.include.jmx.reporter	stream	true
statestore.cache.max.bytes	stream	10485760 (10 mebibytes)

Changed Defaults

Config	Old Default	New Default
inter.broker.protocol.version	3.3-IV3	3.4-IV0
metadata.max.retention.bytes	-1	104857600 (100 mebibytes)
ssl.enabled.protocols	TLSv1.2,TLSv1.3	TLSv1.2
ssl.protocol	TLSv1.3	TLSv1.2
ssl.enabled.protocols	TLSv1.2,TLSv1.3	TLSv1.2
ssl.protocol	TLSv1.3	TLSv1.2
ssl.enabled.protocols	TLSv1.2,TLSv1.3	TLSv1.2
ssl.protocol	TLSv1.3	TLSv1.2
ssl.enabled.protocols	TLSv1.2,TLSv1.3	TLSv1.2
ssl.protocol	TLSv1.3	TLSv1.2
state.dir	/var/folders/8t/s723rqwx1h78qt3w98cp_gsm0000gp/T//kafka-streams	/var/folders/0t/68svdzmx1sld0mxjl8dgmmzm0000gq/T//kafka-streams

Protocol Changes

BrokerRegistration v1 · BrokerRegistration v1

KIPs Released

KIP-830 Allow disabling JMX Reporter
KIP-854 Separate configuration for producer ID expiry
KIP-865 Support --bootstrap-server in kafka-streams-application-reset
KIP-866 ZooKeeper to KRaft Migration
KIP-876 Time based cluster metadata snapshots
KIP-881 Rack-aware Partition Assignment for Kafka Consumers