Kafka 2.1 → 2.2 Upgrade Guide

Kafka 2.2 brings 4 new configs, removes 0, and changes 6 defaults compared to 2.1.

+4 configs 6 defaults changed 17 KIPs

New Configurations

Config	Category	Default
connections.max.reauth.ms	broker	0
control.plane.listener.name	broker	null
group.max.size	broker	2147483647
ssl.principal.mapping.rules	broker	DEFAULT

Changed Defaults

Config	Old Default	New Default
inter.broker.protocol.version	2.1-IV2	2.2-IV1
log.message.format.version	2.1-IV2	2.2-IV1
group.id		null
message.format.version	2.1-IV2	2.2-IV1
config.action.reload	RESTART	restart
config.action.reload	RESTART	restart

Protocol Changes

Produce v4 · Produce v4 · Fetch v5 · Fetch v5 · Metadata v1 · Metadata v1 · OffsetCommit v3 · OffsetCommit v3 · OffsetFetch v2 · OffsetFetch v2 · FindCoordinator v1 · FindCoordinator v1 · JoinGroup v1 · JoinGroup v1 · Heartbeat v1 · Heartbeat v1 · LeaveGroup v1 · LeaveGroup v1 · SyncGroup v1 · SyncGroup v1 · DescribeGroups v1 · DescribeGroups v1 · ListGroups v1 · ListGroups v1 · SaslHandshake v1 · SaslHandshake v1 · ApiVersions v1 · ApiVersions v1 · CreateTopics v3 · CreateTopics v3 · DeleteTopics v2 · DeleteTopics v2 · DeleteRecords v1 · DeleteRecords v1 · InitProducerId v1 · InitProducerId v1 · AddPartitionsToTxn v1 · AddPartitionsToTxn v1 · AddOffsetsToTxn v1 · AddOffsetsToTxn v1 · EndTxn v1 · EndTxn v1 · TxnOffsetCommit v1 · TxnOffsetCommit v1 · DescribeConfigs v2 · DescribeConfigs v2 · AlterConfigs v1 · AlterConfigs v1 · SaslAuthenticate v1 · SaslAuthenticate v1 · CreatePartitions v1 · CreatePartitions v1 · DeleteGroups v1 · DeleteGroups v1

KIPs Released

KIP-110 Add Codec for ZStandard Compression
KIP-183 Change PreferredReplicaLeaderElectionCommand to use AdminClient
KIP-207 Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change
KIP-289 Improve the default group id behavior in KafkaConsumer
KIP-291 Separating controller connections and requests from the data plane
KIP-313 Add KStream.flatTransform and KStream.flatTransformValues
KIP-320 Allow fetchers to detect and handle log truncation
KIP-368 KIP 368: Allow SASL Connections to Periodically Re-Authenticate
KIP-371 Add a configuration to build custom SSL principal name
KIP-374 Add '--help' option to all available Kafka CLI commands
KIP-376 Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement
KIP-377 TopicCommand to use AdminClient
KIP-380 Detect outdated control requests and bounced brokers using broker generation
KIP-393 Time windowed serde to properly deserialize changelog input topic
KIP-394 Require member.id for initial join group request
KIP-402 Improve fairness in SocketServer processors
KIP-414 Expose Embedded ClientIds in Kafka Streams