kennknowles commented on code in PR #30545:
URL: https://github.com/apache/beam/pull/30545#discussion_r1531103924
##########
runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkStreamingTransformTranslators.java:
##########
@@ -921,6 +926,38 @@ public void translateNode(
}
}
+ private static class RedistributeByKeyTranslatorStreaming<K, InputT>
+ extends FlinkStreamingPipelineTranslator.StreamTransformTranslator<
+ PTransform<PCollection<KV<K, InputT>>, PCollection<KV<K, InputT>>>> {
+
+ @Override
+ public void translateNode(
+ PTransform<PCollection<KV<K, InputT>>, PCollection<KV<K, InputT>>>
transform,
+ FlinkStreamingTranslationContext context) {
+
+ DataStream<WindowedValue<KV<K, InputT>>> inputDataSet =
+ context.getInputDataStream(context.getInput(transform));
+
+ context.setOutputDataStream(context.getOutput(transform),
inputDataSet.rebalance());
Review Comment:
How about we do Reshuffle and Redistribute together in a follow-up PR. This
one touches so much that it is a bit sensitive to being prodded. Currently it
is at parity on Flink.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
