This is an automated email from the ASF dual-hosted git repository.
kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 70a520c Merge pull request #4408 from youngoli/beam3126
add 7dabe21 Move DoFnAndMainOutput to top level
add ecde52c Move DoFnSignature helpers to DoFnSignatures and rename
add 6e90e80 Clarify names and visibility of ParDoTranslation helpers
add 32fc290 Make default ParDo output tag explicit
add d70d431 Fix coders in Java SDK harness
add 1c5346f More logging and error checking in ProcessBundleHandler
add a33f0dc Pass portable transform IDs in Dataflow runner
add 8afe0be Correct getAdditionalInputs for Dataflow single-output ParDo
override
new e977cdf Merge pull request #4356: [BEAM-2963] Pass portable transform
IDs in Dataflow translation
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../core/construction/CombineTranslation.java | 2 +-
.../core/construction/ParDoTranslation.java | 143 ++++++-----------
.../core/construction/PipelineTranslation.java | 8 +-
.../core/construction/RehydratedComponents.java | 9 +-
.../runners/core/construction/SdkComponents.java | 6 +
.../core/construction/WriteFilesTranslation.java | 2 +-
.../core/construction/ParDoTranslationTest.java | 5 +-
runners/google-cloud-dataflow-java/pom.xml | 5 +
.../dataflow/DataflowPipelineTranslator.java | 99 ++++++++----
.../beam/runners/dataflow/DataflowRunner.java | 43 ++++--
.../dataflow/PrimitiveParDoSingleFactory.java | 172 ++++++++++++++++++++-
.../beam/runners/dataflow/TransformTranslator.java | 5 +
.../dataflow/DataflowPipelineTranslatorTest.java | 118 +-------------
.../beam/runners/dataflow/DataflowRunnerTest.java | 125 +++++++++++++++
.../java/org/apache/beam/sdk/transforms/ParDo.java | 5 +-
.../sdk/transforms/reflect/DoFnSignatures.java | 47 ++++++
.../apache/beam/sdk/util/DoFnAndMainOutput.java} | 20 ++-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 18 +--
.../fn/harness/control/ProcessBundleHandler.java | 18 ++-
19 files changed, 565 insertions(+), 285 deletions(-)
copy
sdks/java/{io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/Transaction.java
=> core/src/main/java/org/apache/beam/sdk/util/DoFnAndMainOutput.java} (65%)
--
To stop receiving notification emails like this one, please contact
['"[email protected]" <[email protected]>'].
