Kafka Configs Kafka Protocol Wire Format API Versions KIPs Errors Kafka Upgrade Config Advisor Flink SQL
conduktor.io ↗
KIPs / KIP-731

KIP-731 — Record Rate Limiting for Kafka Connect

Discussion Connect

Adds producer-level throughput quotas to Kafka Connect tasks, configurable per connector, to prevent a single connector from exhausting shared network bandwidth or overwhelming downstream systems. Connect has no QoS mechanism, so a high-throughput connector (e.g. MirrorMaker) can starve other connectors or saturate external endpoints that have no rate-limiting of their own.

Details

AuthorRyanne Dolan
StatusDiscussion
JIRAKAFKA-12645
WikiView on Apache Wiki
Created2021-04-09
Last Modified2021-05-14
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.