Guozhang Wang created KAFKA-3561:
------------------------------------

             Summary: Auto create through topic for KStream aggregation and join
                 Key: KAFKA-3561
                 URL: https://issues.apache.org/jira/browse/KAFKA-3561
             Project: Kafka
          Issue Type: Bug
          Components: streams
            Reporter: Guozhang Wang
            Assignee: Guozhang Wang
             Fix For: 0.10.1.0


For KStream.join / aggregateByKey operations that requires the streams to be 
partitioned on the record key, today users should repartition themselves 
through the "through" call:

{code}
stream1 = builder.stream("topic1");
stream2 = builder.stream("topic2");

stream3 = stream1.map(/* set the right key for join*/).through("topic3");
stream4 = stream2.map(/* set the right key for join*/).through("topic4");

stream3.join(stream4, ..)
{code}

This pattern can actually be done by the Streams DSL itself instead of 
requiring users to specify themselves, i.e. users can just set the right key 
like (see KAFKA-3430) and then call join, which will be translated by adding 
the "internal topic for repartition".



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to