[
https://issues.apache.org/jira/browse/KAFKA-15299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Igor Fomenko updated KAFKA-15299:
-
Description:
KIP-955:
[https://cwiki.apache.org/confluence/display/KAFKA/KIP-955%3A+Add+stream-table+join+on+foreign+key]
Currently in Kafka Streams DSL, KStream to KTable joins could only be performed
with the keys. However in practice it is often required to join the messages in
Kafka topics using message field as a "foreign key" with the following pattern:
streamX.leftJoin(tableY, RecordTableY::getForegnKey,
joiner).to("output-topic-name")
The left loin on foreign key operation will result in a stream of messages from
two topics joined on foreign key where 0 or more output message is produced for
each event on the input stream.
was:
KIP-955:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-955%3A+Add+stream-table+join+on+foreign+key
Currently in Kafka Streams DSL, KStream to KTable joins could only be performed
with the keys. However in practice it is often required to join the messages in
Kafka topics using message field as a "foreign key" with the following pattern:
streamX.leftJoin(tableY, RecordTableY::getForegnKey,
joiner).to("output-topic-name")
The left loin on foreign key operation will result in a stream of messages from
two topics joined on foreign key where each output message is produced for each
event on the input stream.
> Support left stream-table join on foreign key
> -
>
> Key: KAFKA-15299
> URL: https://issues.apache.org/jira/browse/KAFKA-15299
> Project: Kafka
> Issue Type: New Feature
> Components: streams
>Reporter: Igor Fomenko
>Assignee: Igor Fomenko
>Priority: Major
> Labels: kip
> Original Estimate: 672h
> Remaining Estimate: 672h
>
> KIP-955:
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-955%3A+Add+stream-table+join+on+foreign+key]
> Currently in Kafka Streams DSL, KStream to KTable joins could only be
> performed with the keys. However in practice it is often required to join the
> messages in Kafka topics using message field as a "foreign key" with the
> following pattern:
>
> streamX.leftJoin(tableY, RecordTableY::getForegnKey,
> joiner).to("output-topic-name")
>
> The left loin on foreign key operation will result in a stream of messages
> from two topics joined on foreign key where 0 or more output message is
> produced for each event on the input stream.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
