Kafka 2.4 → 2.5 Upgrade Guide

Kafka 2.5 brings 19 new configs, removes 0, and changes 18 defaults compared to 2.4.

+19 configs 18 defaults changed 18 KIPs

New Configurations

Config	Category	Default
fetch.max.bytes	broker	57671680
zookeeper.clientCnxnSocket	broker	null
zookeeper.ssl.cipher.suites	broker	null
zookeeper.ssl.client.enable	broker	false
zookeeper.ssl.crl.enable	broker	false
zookeeper.ssl.enabled.protocols	broker	null
zookeeper.ssl.endpoint.identification.algorithm	broker	HTTPS
zookeeper.ssl.keystore.location	broker	null
zookeeper.ssl.keystore.password	broker	null
zookeeper.ssl.keystore.type	broker	null
zookeeper.ssl.ocsp.enable	broker	false
zookeeper.ssl.protocol	broker	TLSv1.2
zookeeper.ssl.truststore.location	broker	null
zookeeper.ssl.truststore.password	broker	null
zookeeper.ssl.truststore.type	broker	null
metadata.max.idle.ms	producer	300000
topic.tracking.allow.reset	connect_default	true
topic.tracking.enable	connect_default	true
built.in.metrics.version	stream	latest

Changed Defaults

Config	Old Default	New Default
inter.broker.protocol.version	2.4-IV1	2.5-IV0
listener.security.protocol.map	PLAINTEXT	PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL
log.message.format.version	2.4-IV1	2.5-IV0
message.max.bytes	1000012	1048588
replica.lag.time.max.ms	10000	30000
ssl.enabled.protocols	TLSv1.2,TLSv1.1,TLSv1	TLSv1.2
ssl.protocol	TLS	TLSv1.2
transaction.abort.timed.out.transaction.cleanup.interval.ms	60000	10000
zookeeper.session.timeout.ms	6000	18000
ssl.enabled.protocols	TLSv1.2,TLSv1.1,TLSv1	TLSv1.2
ssl.protocol	TLS	TLSv1.2
ssl.enabled.protocols	TLSv1.2,TLSv1.1,TLSv1	TLSv1.2
ssl.protocol	TLS	TLSv1.2
max.message.bytes	1000012	1048588
message.format.version	2.4-IV1	2.5-IV0
bootstrap.servers	localhost	localhost:9092
ssl.enabled.protocols	TLSv1.2,TLSv1.1,TLSv1	TLSv1.2
ssl.protocol	TLS	TLSv1.2

Protocol Changes

OffsetFetch v7 · OffsetFetch v7 · JoinGroup v7 · JoinGroup v7 · SyncGroup v5 · SyncGroup v5 · InitProducerId v3 · InitProducerId v3 · TxnOffsetCommit v3 · TxnOffsetCommit v3 · DescribeAcls v2 · DescribeAcls v2 · CreateAcls v2 · CreateAcls v2 · DeleteAcls v2 · DeleteAcls v2 · SaslAuthenticate v2 · SaslAuthenticate v2 · CreatePartitions v2 · CreatePartitions v2 · RenewDelegationToken v2 · RenewDelegationToken v2 · ExpireDelegationToken v2 · ExpireDelegationToken v2 · DescribeDelegationToken v2 · DescribeDelegationToken v2

KIPs Released

KIP-150 Kafka-Streams Cogroup
KIP-352 Distinguish URPs caused by reassignment
KIP-441 Smooth Scaling Out for Kafka Streams
KIP-447 Producer scalability for exactly once semantics
KIP-499 Unify connection name flag for command line tool
KIP-515 Enable ZK client to use the new TLS supported authentication
KIP-524 Allow users to choose config source when describing configs
KIP-526 Reduce Producer Metadata Lookups for Large Number of Topics
KIP-527 Add VoidSerde to Serdes
KIP-531 Drop support for Scala 2.11 in Kafka 2.5
KIP-533 Add default api timeout to AdminClient
KIP-537 Increase default zookeeper session timeou
KIP-538 Add a metric tracking the number of open connections with a given SSL cipher type
KIP-543 Expand ConfigCommand's non-ZK functionality
KIP-555 Deprecate direct Zookeeper access in Kafka administrative tools
KIP-558 Track the set of actively used topics by connectors in Kafka Connect
KIP-562 Allow fetching a key from a single partition rather than iterating over all the stores on an instance
KIP-648 Renaming getter method for Interactive Queries