This is an automated email from the ASF dual-hosted git repository.
jkff pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from ca4e284 A few small fixes to catch a few regressions - put String
literals fi…
add 06ed16b Move SyntheticNodes to top-level construction package and
rename
add 8346c83 Pull Flink execution environment utilities into static methods
add 7e6bef9 Refactor Runner/SDK wire coder creation into a shared utility
add 1e47617 [BEAM-3972] Translate portable batch pipelines by proto
add c80f90a FIXUP: Use ModelCoders to create proto coders and use
WireCoders to create sdk coders
add 4686be1 FIXUP: Use RunnerApi in WireCoders to prepare for coder
instantiation
new 5cb3969 Merge pull request #5226: [BEAM-3972] Translate portable
batch pipelines by proto
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
...yntheticNodes.java => SyntheticComponents.java} | 8 +-
.../core/construction/graph/FusedPipeline.java | 3 +-
.../construction/graph/OutputDeduplicator.java | 5 +-
runners/flink/build.gradle | 1 +
runners/flink/pom.xml | 11 +
.../FlinkBatchPortablePipelineTranslator.java | 610 +++++++++++++++++++++
...onment.java => FlinkExecutionEnvironments.java} | 153 ++----
.../flink/FlinkPipelineExecutionEnvironment.java | 145 +----
.../flink/FlinkPortablePipelineTranslator.java} | 25 +-
.../functions/FlinkExecutableStageFunction.java | 73 +++
...va => FlinkExecutableStagePruningFunction.java} | 31 +-
.../control/ProcessBundleDescriptors.java | 43 +-
.../{graph => wire}/LengthPrefixUnknownCoders.java | 2 +-
.../beam/runners/fnexecution/wire/WireCoders.java | 65 +++
.../runners/fnexecution/wire}/package-info.java | 6 +-
.../LengthPrefixUnknownCodersTest.java | 2 +-
16 files changed, 846 insertions(+), 337 deletions(-)
rename
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/{graph/SyntheticNodes.java
=> SyntheticComponents.java} (87%)
create mode 100644
runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkBatchPortablePipelineTranslator.java
copy
runners/flink/src/main/java/org/apache/beam/runners/flink/{FlinkPipelineExecutionEnvironment.java
=> FlinkExecutionEnvironments.java} (51%)
copy
runners/{core-construction-java/src/main/java/org/apache/beam/runners/core/construction/BeamUrns.java
=>
flink/src/main/java/org/apache/beam/runners/flink/FlinkPortablePipelineTranslator.java}
(51%)
create mode 100644
runners/flink/src/main/java/org/apache/beam/runners/flink/translation/functions/FlinkExecutableStageFunction.java
copy
runners/flink/src/main/java/org/apache/beam/runners/flink/translation/functions/{FlinkMultiOutputPruningFunction.java
=> FlinkExecutableStagePruningFunction.java} (56%)
rename
runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/{graph
=> wire}/LengthPrefixUnknownCoders.java (99%)
create mode 100644
runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/wire/WireCoders.java
copy runners/{apex/src/test/java/org/apache/beam/runners/apex/examples =>
java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/wire}/package-info.java
(87%)
rename
runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/{graph
=> wire}/LengthPrefixUnknownCodersTest.java (99%)
--
To stop receiving notification emails like this one, please contact
[email protected].
