Kafka 2.7 → 2.8 Upgrade Guide

Kafka 2.8 brings 2 new configs, removes 0, and changes 9 defaults compared to 2.7.

+2 configs 9 defaults changed 18 KIPs

New Configurations

Config	Category	Default
delegation.token.secret.key	broker	null
window.size.ms	stream	null

Changed Defaults

Config	Old Default	New Default
inter.broker.protocol.version	2.7-IV2	2.8-IV1
log.message.format.version	2.7-IV2	2.8-IV1
socket.connection.setup.timeout.max.ms	127000 (127 seconds)	30000 (30 seconds)
zookeeper.connect		null
socket.connection.setup.timeout.max.ms	127000 (127 seconds)	30000 (30 seconds)
socket.connection.setup.timeout.max.ms	127000 (127 seconds)	30000 (30 seconds)
message.format.version	2.7-IV2	2.8-IV1
socket.connection.setup.timeout.max.ms	127000 (127 seconds)	30000 (30 seconds)
state.dir	/tmp/kafka-streams	/var/folders/st/wn8xlbk16ml31qrqpyh28rlc0000gn/T//kafka-streams

Protocol Changes

Produce v9 · Produce v9 · ListOffsets v2 · ListOffsets v2 · Metadata v10 · Metadata v10 · CreateTopics v7 · CreateTopics v7 · DeleteTopics v6 · DeleteTopics v6 · OffsetForLeaderEpoch v4 · OffsetForLeaderEpoch v4 · AddPartitionsToTxn v3 · AddPartitionsToTxn v3 · AddOffsetsToTxn v3 · AddOffsetsToTxn v3 · EndTxn v3 · EndTxn v3 · DescribeConfigs v4 · DescribeConfigs v4 · AlterConfigs v2 · AlterConfigs v2 · AlterReplicaLogDirs v2 · AlterReplicaLogDirs v2 · DescribeClientQuotas v1 · DescribeClientQuotas v1 · AlterClientQuotas v1 · AlterClientQuotas v1

KIPs Released

KIP-418 A method-chaining way to branch KStream
KIP-500 Replace ZooKeeper with a Self-Managed Metadata Quorum
KIP-572 Improve timeouts and retries in Kafka Streams
KIP-614 Add Prefix Scan support for State Stores
KIP-630 Kafka Raft Snapshot
KIP-631 The Quorum-based Kafka Controller
KIP-659 Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size
KIP-661 Expose task configurations in Connect REST API
KIP-663 API to Start and Shut Down Stream Threads
KIP-671 Introduce Kafka Streams Specific Uncaught Exception Handler
KIP-673 Emit JSONs with new auto-generated schema
KIP-676 Respect logging hierarchy
KIP-679 Producer will enable the strongest delivery guarantee by default
KIP-680 TopologyTestDriver should not require a Properties argument
KIP-684 Support mutual TLS authentication on SASL_SSL listeners
KIP-689 Extend `StreamJoined` to allow more store configs
KIP-696 Update Streams FSM to clarify ERROR state meaning
KIP-700 Add Describe Cluster API