Kafka 3.1 → 3.2 Upgrade Guide

Kafka 3.2 brings 4 new configs, removes 1, and changes 10 defaults compared to 3.1.

+4 configs −1 configs 10 defaults changed 23 KIPs

Removed Configurations

Config	Category
zookeeper.sync.time.ms	broker

New Configurations

Config	Category	Default
socket.listen.backlog.size	broker	50
default.dsl.store	stream	rocksDB
rack.aware.assignment.tags	stream
repartition.purge.interval.ms	stream	30000 (30 seconds)

Changed Defaults

Config	Old Default	New Default
inter.broker.protocol.version	3.1-IV0	3.2-IV0
ssl.enabled.protocols	TLSv1.2,TLSv1.3	TLSv1.2
ssl.protocol	TLSv1.3	TLSv1.2
ssl.enabled.protocols	TLSv1.2,TLSv1.3	TLSv1.2
ssl.protocol	TLSv1.3	TLSv1.2
ssl.enabled.protocols	TLSv1.2,TLSv1.3	TLSv1.2
ssl.protocol	TLSv1.3	TLSv1.2
ssl.enabled.protocols	TLSv1.2,TLSv1.3	TLSv1.2
ssl.protocol	TLSv1.3	TLSv1.2
state.dir	/tmp/kafka-streams	/var/folders/ds/dq10m26j2kjcypywn_lt0b0m0000gn/T//kafka-streams

Protocol Changes

JoinGroup v8 · JoinGroup v8 · LeaveGroup v5 · LeaveGroup v5 · DescribeLogDirs v3 · DescribeLogDirs v3

KIPs Released

KIP-591 Add Kafka Streams config to set default state store
KIP-618 Exactly-Once Support for Source Connectors
KIP-704 Send a hint to the partition leader to recover the partition
KIP-708 Rack aware StandbyTask assignment for Kafka Streams
KIP-764 Configurable backlog size for creating Acceptor
KIP-769 Connect APIs to list all connector plugins and retrieve their configuration definitions
KIP-779 Allow Source Tasks to Handle Producer Exceptions
KIP-784 Add top-level error code field to DescribeLogDirsResponse
KIP-788 Allow configuring num.network.threads per listener
KIP-791 Add Record Metadata to StateStoreContext
KIP-796 Interactive Query v2
KIP-798 Add possibility to write kafka headers in Kafka Console Producer
KIP-799 Align behaviour for producer callbacks with documented behaviour
KIP-800 Add reason to JoinGroupRequest and LeaveGroupRequest
KIP-801 Implement an Authorizer that stores metadata in __cluster_metadata
KIP-805 Add range and scan query over kv-store in IQv2
KIP-806 Add session and window query over kv-store in IQv2
KIP-808 Add support for different unix precisions in TimestampConverter SMT
KIP-810 Allow producing records with null values in Kafka Console Producer
KIP-811 Add config repartition.purge.interval.ms to Kafka Streams
KIP-814 Static membership protocol should let the leader skip assignment
KIP-815 Support max-timestamp in GetOffsetShell
KIP-825 introduce a new API to control when aggregated results are produced