This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from dcda09a Merge pull request #7485: [BEAM-6408] Fix load test job
new afe1a84 Create a standard coder for utf-8 encoded strings.
new 326ebd1 [BEAM-6269] Cross-SDK transform expansion protocol.
new 26bd104 Merge pull request #7316 [BEAM-6269] Cross-SDK transform
expansion protocol.
The 19732 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
model/job-management/build.gradle | 5 +-
.../src/main/proto/beam_expansion_api.proto | 68 +++++++
.../pipeline/src/main/proto/beam_runner_api.proto | 3 +
runners/core-construction-java/build.gradle | 18 ++
.../core/construction/ExpansionService.java | 205 ++++++++++++++++++++
.../core/construction/ModelCoderRegistrar.java | 3 +
.../runners/core/construction/ModelCoders.java | 2 +
.../core/construction/RehydratedComponents.java | 11 ++
.../runners/core/construction/SdkComponents.java | 57 +++++-
.../core/construction/CoderTranslationTest.java | 1 +
.../core/construction/ExpansionServiceTest.java | 103 ++++++++++
.../core/construction/TestExpansionService.java | 52 ++++++
.../fnexecution/control/RemoteExecutionTest.java | 32 +---
.../beam/sdk/runners/TransformHierarchy.java | 28 ++-
sdks/python/apache_beam/coders/coders.py | 36 ++++
sdks/python/apache_beam/pipeline.py | 30 +--
sdks/python/apache_beam/pvalue.py | 12 +-
.../python/apache_beam/runners/pipeline_context.py | 34 +++-
.../apache_beam/runners/pipeline_context_test.py | 8 +
.../runners/portability/expansion_service.py | 118 ++++++++++++
sdks/python/apache_beam/transforms/__init__.py | 1 +
sdks/python/apache_beam/transforms/external.py | 208 +++++++++++++++++++++
.../python/apache_beam/transforms/external_test.py | 205 ++++++++++++++++++++
sdks/python/apache_beam/transforms/ptransform.py | 46 ++++-
sdks/python/build.gradle | 12 ++
25 files changed, 1233 insertions(+), 65 deletions(-)
create mode 100644 model/job-management/src/main/proto/beam_expansion_api.proto
create mode 100644
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/ExpansionService.java
create mode 100644
runners/core-construction-java/src/test/java/org/apache/beam/runners/core/construction/ExpansionServiceTest.java
create mode 100644
runners/core-construction-java/src/test/java/org/apache/beam/runners/core/construction/TestExpansionService.java
create mode 100644
sdks/python/apache_beam/runners/portability/expansion_service.py
create mode 100644 sdks/python/apache_beam/transforms/external.py
create mode 100644 sdks/python/apache_beam/transforms/external_test.py
