Kafka 4.3 → 4.4 Upgrade Guide

Kafka 4.4 brings 34 new configs, removes 0, and changes 0 defaults compared to 4.3.

+34 configs 27 KIPs

New Configurations

Config	Category	Default
errors.deadletterqueue.auto.create.topics.enable	broker	false
errors.deadletterqueue.topic.name.prefix	broker	dlq.
group.streams.assignors	broker	sticky
group.streams.rack.aware.assignment.tags	broker
group.streams.topology.description.plugin.class	broker	null
log.remote.copy.lag.bytes	broker	-1
log.remote.copy.lag.ms	broker	0
max.decompressed.message.bytes	broker	2147483639
sasl.oauthbearer.allow.unverified.audience	broker	false
sasl.oauthbearer.allow.unverified.issuer	broker	false
bootstrap.resolve.timeout.ms	consumer	0
metadata.cluster.check.enable	consumer	true
sasl.oauthbearer.allow.unverified.audience	consumer	false
sasl.oauthbearer.allow.unverified.issuer	consumer	false
bootstrap.resolve.timeout.ms	producer	0
client.rack	producer
metadata.cluster.check.enable	producer	true
partitioner.rack.aware	producer	false
sasl.oauthbearer.allow.unverified.audience	producer	false
sasl.oauthbearer.allow.unverified.issuer	producer	false
errors.deadletterqueue.group.enable	topic	false
max.decompressed.message.bytes	topic	2147483639
remote.copy.lag.bytes	topic	-1
remote.copy.lag.ms	topic	0
bootstrap.resolve.timeout.ms	connect_default	0
internal.topics.automatic.creation.enable	connect_default	true
metadata.cluster.check.enable	connect_default	true
sasl.oauthbearer.allow.unverified.audience	connect_default	false
sasl.oauthbearer.allow.unverified.issuer	connect_default	false
default.interactive.query.isolation.level	stream	READ_UNCOMMITTED
enable.transactional.statestores	stream	false
metadata.cluster.check.enable	stream	true
statestore.uncommitted.max.bytes	stream	67108864 (64 mebibytes)
topology.description.push.enabled	stream	true

Protocol Changes

ApiVersions v5 · ApiVersions v5 · TxnOffsetCommit v6 · TxnOffsetCommit v6 · DeleteGroups v3 · DeleteGroups v3 · StreamsGroupHeartbeat v1 · StreamsGroupHeartbeat v1 · StreamsGroupDescribe v1 · StreamsGroupDescribe v1

KIPs Released

KIP-892 Transactional Semantics for StateStores
KIP-909 DNS Resolution Failure Should Not Fail the Clients
KIP-1170 Unify cluster metadata bootstrapping
KIP-1191 Dead-letter queues for share groups
KIP-1200 Deprecate ClientQuotaCallback#updateClusterMetadata
KIP-1209 Add configuration to control internal topic creation in Kafka Connect
KIP-1220 Unify kafka-broker-api-versions tool to cluster-tool and support bootstrap controllers
KIP-1232 Deprecate broker.id config
KIP-1241 Reduce tiered storage redundancy with delayed upload
KIP-1242 Detection and handling of misrouted connections
KIP-1245 Enforce 'application.server' <server>:<port> format at config level
KIP-1250 Add metric to track size of in-memory state stores
KIP-1265 Mechanism for automatic detection of internal API usage
KIP-1271 Allow to Store Record Headers in State Stores
KIP-1283 Clarify KafkaStreams cleanUp semantics to preserve process metadata and state directory lock file
KIP-1284 Introduce CloseOptions.DEFAULT for Kafka Streams
KIP-1291 Extended I/O Metrics Collection
KIP-1299 Use key range in ProducerPerformance
KIP-1301 Deprecate Yammer-based metrics in `GroupCoordinatorMetrics`
KIP-1312 Support unregistering controllers
KIP-1319 Align TxnOffsetCommit API with OffsetCommit API
KIP-1321 Headers aware StreamPartitioner
KIP-1323 Initialization of share group offsets from a specific offset or a file
KIP-1331 Streams Group Topology Description Plugin
KIP-1340 Expose Both Mapped Key and Stream Key in Streams-GlobalKTable Joins
KIP-1356 Introduce IQv2 for headers-aware state stores
KIP-1357 Add broker side custom assignors for "streams" groups