This is an automated email from the ASF dual-hosted git repository.
kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 6fa6a28b397b753ccfb81995509a44f1df32a155
Merge: 673da546c14 bdfc7812fdf
Author: Kenneth Knowles <k...@apache.org>
AuthorDate: Mon Apr 29 08:52:49 2024 -0400
Merge pull request #30545: Add Redistribute transform to model, Java SDK,
and most active runners
...m_PostCommit_Java_ValidatesRunner_Dataflow.json | 3 +
...it_Java_ValidatesRunner_Dataflow_Streaming.json | 3 +
...beam_PostCommit_Java_ValidatesRunner_Flink.json | 3 +
...beam_PostCommit_Java_ValidatesRunner_Samza.json | 3 +
...beam_PostCommit_Java_ValidatesRunner_Spark.json | 3 +
.../beam/model/pipeline/v1/beam_runner_api.proto | 8 +
runners/flink/flink_runner.gradle | 1 +
runners/flink/job-server/flink_job_server.gradle | 2 +
.../FlinkBatchPortablePipelineTranslator.java | 17 +-
.../flink/FlinkBatchTransformTranslators.java | 78 ++++
.../FlinkStreamingPortablePipelineTranslator.java | 22 ++
.../flink/FlinkStreamingTransformTranslators.java | 37 ++
.../dataflow/DataflowPipelineTranslator.java | 37 ++
.../beam/runners/dataflow/util/PropertyNames.java | 1 +
.../translation/RedistributeByKeyTranslator.java | 64 ++++
.../samza/translation/ReshuffleTranslator.java | 14 +-
.../samza/translation/SamzaPipelineTranslator.java | 1 +
.../spark/translation/TransformTranslator.java | 66 ++++
.../streaming/StreamingTransformTranslator.java | 70 ++++
.../apache/beam/sdk/transforms/Redistribute.java | 300 +++++++++++++++
.../util/construction/PTransformTranslation.java | 8 +
.../beam/sdk/transforms/RedistributeTest.java | 410 +++++++++++++++++++++
22 files changed, 1148 insertions(+), 3 deletions(-)
