Kafka 2.2 → 2.3 Upgrade Guide

Kafka 2.3 brings 9 new configs, removes 0, and changes 4 defaults compared to 2.2.

+9 configs 4 defaults changed 28 KIPs

New Configurations

Config	Category	Default
log.cleaner.max.compaction.lag.ms	broker	9223372036854775807
max.connections	broker	2147483647
allow.auto.create.topics	consumer	true
client.rack	consumer
group.instance.id	consumer	null
max.compaction.lag.ms	topic	9223372036854775807
connect.protocol	connect_default	compatible
connector.client.config.override.policy	connect_default	None
scheduled.rebalance.max.delay.ms	connect_default	300000

Changed Defaults

Config	Old Default	New Default
group.max.session.timeout.ms	300000	1800000
inter.broker.protocol.version	2.2-IV1	2.3-IV1
log.message.format.version	2.2-IV1	2.3-IV1
message.format.version	2.2-IV1	2.3-IV1

Protocol Changes

Fetch v11 · Fetch v11 · Metadata v8 · Metadata v8 · OffsetCommit v7 · OffsetCommit v7 · JoinGroup v5 · JoinGroup v5 · Heartbeat v3 · Heartbeat v3 · SyncGroup v3 · SyncGroup v3 · DescribeGroups v3 · DescribeGroups v3 · OffsetForLeaderEpoch v3 · OffsetForLeaderEpoch v3

KIPs Released

KIP-258 Allow to Store Record Timestamps in RocksDB
KIP-307 Allow to define custom processor names with KStreams DSL
KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde
KIP-339 Create a new IncrementalAlterConfigs API
KIP-341 Update Sticky Assignor's User Data Protocol
KIP-345 Introduce static membership protocol to reduce consumer rebalances
KIP-351 Add --under-min-isr option to describe topics command
KIP-354 Add a Maximum Log Compaction Lag
KIP-361 K
KIP-392 Allow consumers to fetch from closest replica
KIP-411 Make default Kafka Connect worker task client IDs distinct
KIP-415 Incremental Cooperative Rebalancing in Kafka Connect
KIP-417 Allow JmxTool to connect to a secured RMI port
KIP-420 Add Single Value Fetch in Session Stores
KIP-421 Support resolving externalized secrets in AbstractConfig
KIP-425 Add some Log4J Kafka Appender Properties for Producing to Secured Brokers
KIP-428 Add in-memory window store
KIP-430 Return Authorized Operations in Describe Responses
KIP-442 Return to default max poll interval in Streams
KIP-443 Return to default segment.ms and segment.index.bytes in Streams repartition topics
KIP-445 In-memory Session Store
KIP-449 Add connector contexts to log messages in Connect workers
KIP-453 Add close() method to RocksDBConfigSetter
KIP-454 Expansion of the ConnectClusterState interface
KIP-458 Connector Client Config Override Policy
KIP-461 Improve Replica Fetcher behavior at handling partition failure
KIP-462 Use local thread id for KStreams
KIP-465 Add Consolidated Connector Endpoint to Connect REST API