Guozhang Wang created KAFKA-3561: ------------------------------------ Summary: Auto create through topic for KStream aggregation and join Key: KAFKA-3561 URL: https://issues.apache.org/jira/browse/KAFKA-3561 Project: Kafka Issue Type: Bug Components: streams Reporter: Guozhang Wang Assignee: Guozhang Wang Fix For: 0.10.1.0
For KStream.join / aggregateByKey operations that requires the streams to be partitioned on the record key, today users should repartition themselves through the "through" call: {code} stream1 = builder.stream("topic1"); stream2 = builder.stream("topic2"); stream3 = stream1.map(/* set the right key for join*/).through("topic3"); stream4 = stream2.map(/* set the right key for join*/).through("topic4"); stream3.join(stream4, ..) {code} This pattern can actually be done by the Streams DSL itself instead of requiring users to specify themselves, i.e. users can just set the right key like (see KAFKA-3430) and then call join, which will be translated by adding the "internal topic for repartition". -- This message was sent by Atlassian JIRA (v6.3.4#6332)