This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from c6c70860400 Enable triggering postcommit via specific file (#29549)
add 35a0b68c06b Fix small doc issues (#29578)
add 7c99c330350 Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks
(#29575)
add 5f6afcef55f Bump cryptography from 41.0.4 to 41.0.6 in
/sdks/python/container/py38 (#29554)
add 90b1a6b7200 Add new AnyOf environment.
add e5a9ab6233e Add AnyOf environment handling to the various runners.
add b136f1d3dd6 Add AnyOf environment handling to the artifact staging
services.
add 6550cec0e9c Add the ability to cache subprocess services for the
duration of a pipeline.
add e8cebdf4fe7 Add an option to start loopback workers in expansion
services.
add e88fb5df887 Use Java expansion services as workers by default in
Python.
add d85ce3f38c5 More complete documentation of environment proto
definitions.
add f337c74b828 Merge pull request #29283 Cross language pipelines without
Docker.
add 26135b07473 Support for upgrading BigQuery transforms without
upgrading the pipeline (#29550)
add ebc4a5585e0 Documents the transform upgrade feature (#29581)
add 39e1615f945 fix typos (#29588)
add 04fe4b53433 Consider underlying providers in both directions when
doing affinity test.
add 85d4fcf7f37 Merge pull request #29586 from Better affinity test.
No new revisions were added by this update.
Summary of changes:
CHANGES.md | 5 +-
.../beam/model/pipeline/v1/beam_runner_api.proto | 34 +-
.../runners/core/construction/Environments.java | 47 ++
.../core/construction/TransformUpgrader.java | 52 +-
.../core/construction/EnvironmentsTest.java | 41 ++
.../beam/runners/dataflow/DataflowRunner.java | 16 +
.../control/DefaultJobBundleFactory.java | 6 +
.../runners/jobsubmission/InMemoryJobService.java | 58 +-
sdks/go.mod | 22 +-
sdks/go.sum | 44 +-
sdks/java/expansion-service/build.gradle | 3 +
.../sdk/expansion/service/ExpansionService.java | 55 +-
.../expansion/service/ExpansionServiceOptions.java | 5 +
.../sdk/io/gcp/bigquery/BigQueryIOTranslation.java | 782 +++++++++++++++++++++
.../io/gcp/bigquery/BigQueryIOTranslationTest.java | 303 ++++++++
.../sdk/io/kafka/upgrade/KafkaIOTranslation.java | 26 +-
sdks/python/apache_beam/io/gcp/bigquery.py | 18 +-
sdks/python/apache_beam/pipeline.py | 10 +-
.../runners/dataflow/dataflow_runner.py | 8 +-
.../runners/portability/expansion_service.py | 14 +-
.../runners/portability/expansion_service_main.py | 16 +-
.../runners/portability/fn_api_runner/fn_runner.py | 29 +-
.../portability/fn_api_runner/worker_handlers.py | 12 +
.../runners/portability/local_job_service.py | 59 +-
sdks/python/apache_beam/transforms/environments.py | 58 ++
sdks/python/apache_beam/transforms/external.py | 27 +-
sdks/python/apache_beam/utils/subprocess_server.py | 192 +++--
.../apache_beam/utils/subprocess_server_test.py | 79 +++
sdks/python/apache_beam/yaml/yaml_provider.py | 6 +-
.../container/py38/base_image_requirements.txt | 2 +-
website/www/site/content/en/blog/beam-2.52.0.md | 69 +-
.../content/en/documentation/programming-guide.md | 64 +-
.../partials/section-menu/en/documentation.html | 1 +
33 files changed, 1949 insertions(+), 214 deletions(-)
create mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOTranslation.java
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOTranslationTest.java
