conduktor.io ↗

check.crcs — Kafka Consumer Configuration

Automatically check the CRC32 of the records consumed. This ensures no on-the-wire or on-disk corruption to the messages occurred.

Description

Automatically check the CRC32 of the records consumed. This ensures no on-the-wire or on-disk corruption to the messages occurred. This check adds some overhead, so it may be disabled in cases seeking extreme performance.

Default Values by Kafka Version

Kafka VersionDefault Value
0.9.0true
0.10.0true
0.10.1true
0.10.2true
0.11.0true
1.0true
1.1true
2.0true
2.1true
2.2true
2.3true
2.4true
2.5true
2.6true
2.7true
2.8true
3.0true
3.1true
3.2true
3.3true
3.4true
3.5true
3.6true
3.7true
3.8true
3.9true
4.0true
4.1true
4.2true

Tuning Recommendation

ProfileRecommendedWhy
consumer / durabilitytrueCRC32 verification on every fetched record detects bit-level data corruption caused by disk errors, memory faults, or network corruption that slipped past TCP checksums. This is a critical integrity guard for durable pipelines where silent data corruption is worse than a detected error.

Related Configs

fetch.max.bytes · max.poll.records

Manage Kafka configs across all your clusters with Conduktor Console — view, compare, and update configurations in one place.