conduktor.io ↗

KIP-775 — Custom partitioners in foreign key joins

Accepted Kafka 3.1 Streams

Enables Kafka Streams foreign-key (FK) table joins to work correctly when the primary or foreign-key tables use custom partitioners by making the subscription and response topics copartition with the relevant tables. Previously FK joins silently produced missing results if either table was partitioned with a non-default partitioner, because lookups could be routed to Streams instances that did not hold the required state.

Details

AuthorVictoria Xia
StatusAccepted
Kafka Version3.1
JIRAKAFKA-13261
WikiView on Apache Wiki
Created2021-09-15
Last Modified2021-10-01
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.