This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 9c75db4760c [YAML] Avro format for PubSub. (#28899)
add 6b3b3eb603f Update go_tests.yml to cache (#28954)
add fb99630d1e0 [Website] Announce Beam 2.51.0
add 0ff6795e268 Merge pull request #28800: [Website] Announce Beam 2.51.0
add 4a7c4842ace Add new resource hint to all sdks for number of cpus per
worker machine (#28848)
add 835bd655948 Add docs for per key inference (#28243)
add fbd147f8354 Use latest released beam in notebook (#28801)
add 7449b67a6d1 Editing notebooks to prepare for DevSite import (#28949)
add 223dded769d Add Inference Python Benchmarks Dataflow workflow (#28943)
add 63b99fb9cbe Remove govulncheck for Go Test workflow (#28966)
add 3e066e3524a Bump com.gradle.common-custom-user-data-gradle-plugin
(#28762)
add a94d29ffd21 Add pyproject.toml (#28385)
add 05861613f48 Fix typo and remove extra button (#28965)
No new revisions were added by this update.
Summary of changes:
... beam_Inference_Python_Benchmarks_Dataflow.yml} | 72 ++++---
.github/workflows/beam_PreCommit_Python.yml | 1 +
.../workflows/beam_PreCommit_Python_Coverage.yml | 2 +
.../workflows/beam_PreCommit_Python_Dataframes.yml | 1 +
.../workflows/beam_PreCommit_Python_Examples.yml | 1 +
.../workflows/beam_PreCommit_Python_Runners.yml | 1 +
.../workflows/beam_PreCommit_Python_Transforms.yml | 1 +
.github/workflows/build_release_candidate.yml | 2 +-
.github/workflows/build_wheels.yml | 17 +-
.github/workflows/dask_runner_tests.yml | 8 +-
.github/workflows/go_tests.yml | 7 +-
...Pytorch_Imagenet_Classification_Resnet_152.txt} | 27 +--
...net_Classification_Resnet_152_Tesla_T4_GPU.txt} | 29 +--
...ytorch_Language_Modeling_Bert_Base_Uncased.txt} | 27 +--
...torch_Language_Modeling_Bert_Large_Uncased.txt} | 27 +--
...w_Pytorch_Vision_Classification_Resnet_101.txt} | 27 +--
.github/workflows/python_dependency_tests.yml | 5 +-
.github/workflows/python_tests.yml | 16 +-
.github/workflows/run_perf_alert_tool.yml | 3 -
.github/workflows/typescript_tests.yml | 7 +-
.test-infra/jenkins/job_PreCommit_Python.groovy | 1 +
.../jenkins/job_PreCommit_Python_Coverage.groovy | 3 +
.../jenkins/job_PreCommit_Python_Dataframes.groovy | 3 +-
.../jenkins/job_PreCommit_Python_Examples.groovy | 3 +-
.../jenkins/job_PreCommit_Python_Runners.groovy | 3 +-
.../jenkins/job_PreCommit_Python_Transforms.groovy | 3 +-
CHANGES.md | 18 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 40 ++--
.../beam-ml/automatic_model_refresh.ipynb | 8 +-
examples/notebooks/beam-ml/mltransform_basic.ipynb | 18 +-
examples/notebooks/beam-ml/per_key_models.ipynb | 25 +--
.../beam/model/pipeline/v1/beam_runner_api.proto | 4 +
.../src/main/scripts/build_release_candidate.sh | 2 +-
.../beam/model/fnexecution_v1/beam_fn_api.pb.go | 67 +++++--
.../model/fnexecution_v1/beam_fn_api_grpc.pb.go | 2 +-
.../model/fnexecution_v1/beam_provision_api.pb.go | 2 +-
.../fnexecution_v1/beam_provision_api_grpc.pb.go | 2 +-
.../model/jobmanagement_v1/beam_artifact_api.pb.go | 2 +-
.../jobmanagement_v1/beam_artifact_api_grpc.pb.go | 2 +-
.../jobmanagement_v1/beam_expansion_api.pb.go | 2 +-
.../jobmanagement_v1/beam_expansion_api_grpc.pb.go | 2 +-
.../beam/model/jobmanagement_v1/beam_job_api.pb.go | 2 +-
.../model/jobmanagement_v1/beam_job_api_grpc.pb.go | 2 +-
.../beam/model/pipeline_v1/beam_runner_api.pb.go | 81 ++++----
.../model/pipeline_v1/beam_runner_api_grpc.pb.go | 2 +-
sdks/go/pkg/beam/model/pipeline_v1/endpoints.pb.go | 2 +-
.../model/pipeline_v1/external_transforms.pb.go | 2 +-
sdks/go/pkg/beam/model/pipeline_v1/metrics.pb.go | 2 +-
sdks/go/pkg/beam/model/pipeline_v1/schema.pb.go | 2 +-
.../model/pipeline_v1/standard_window_fns.pb.go | 2 +-
sdks/go/pkg/beam/options/resource/hint.go | 37 ++++
sdks/go/pkg/beam/options/resource/hint_test.go | 45 ++++-
.../transforms/resourcehints/ResourceHints.java | 63 +++++++
.../resourcehints/ResourceHintsTest.java | 11 +-
sdks/python/apache_beam/coders/slow_coders_test.py | 3 +
.../apache_beam/examples/inference/README.md | 1 -
.../apache_beam/examples/kafkataxi/README.md | 4 +-
.../io/azure/integration_test/Dockerfile | 2 +-
sdks/python/apache_beam/io/gcp/bigquery_test.py | 39 +++-
.../io/hdfs_integration_test/Dockerfile | 2 +-
.../apache_beam/ml/gcp/naturallanguageml_test.py | 19 --
sdks/python/apache_beam/ml/inference/base.py | 9 +-
sdks/python/apache_beam/runners/common.py | 4 +-
.../apache_beam/runners/portability/stager.py | 28 ++-
sdks/python/apache_beam/transforms/resources.py | 16 ++
.../apache_beam/transforms/resources_test.py | 6 +
sdks/python/build-requirements.txt | 28 ---
sdks/python/build.gradle | 7 +-
sdks/python/container/Dockerfile | 2 +-
.../container/base_image_requirements_manual.txt | 1 +
sdks/python/gen_protos.py | 105 ++++-------
.../gcp/pubsublite/__init__.py => pyproject.toml} | 23 ++-
sdks/python/scripts/run_pytest.sh | 4 +-
sdks/python/scripts/run_tox.sh | 19 +-
sdks/python/setup.py | 59 +++---
sdks/python/test-suites/tox/common.gradle | 12 +-
sdks/python/test-suites/tox/py310/build.gradle | 2 -
sdks/python/test-suites/tox/py311/build.gradle | 2 -
sdks/python/test-suites/tox/py38/build.gradle | 2 -
sdks/python/test-suites/tox/py39/build.gradle | 3 -
sdks/python/tox.ini | 32 +---
settings.gradle.kts | 2 +-
website/www/site/config.toml | 2 +-
website/www/site/content/en/blog/beam-2.51.0.md | 210 +++++++++++++++++++++
.../documentation/ml/multi-language-inference.md | 2 +-
.../documentation/sdks/python-machine-learning.md | 48 +++++
.../sdks/python-pipeline-dependencies.md | 13 +-
.../www/site/content/en/get-started/downloads.md | 14 +-
88 files changed, 957 insertions(+), 514 deletions(-)
copy .github/workflows/{beam_LoadTests_Python_GBK_Dataflow_Batch.yml =>
beam_Inference_Python_Benchmarks_Dataflow.yml} (50%)
copy
.github/workflows/load-tests-job-configs/{config_CoGBK_Go_Batch_MultipleKey.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Imagenet_Classification_Resnet_152.txt}
(60%)
copy
.github/workflows/load-tests-job-configs/{config_CoGBK_Go_Batch_MultipleKey.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Imagenet_Classification_Resnet_152_Tesla_T4_GPU.txt}
(54%)
copy
.github/workflows/load-tests-job-configs/{config_CoGBK_Go_Batch_MultipleKey.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Language_Modeling_Bert_Base_Uncased.txt}
(60%)
copy
.github/workflows/load-tests-job-configs/{config_CoGBK_Go_Batch_MultipleKey.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Language_Modeling_Bert_Large_Uncased.txt}
(60%)
copy
.github/workflows/load-tests-job-configs/{config_CoGBK_Go_Batch_MultipleKey.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Vision_Classification_Resnet_101.txt}
(60%)
delete mode 100644 sdks/python/build-requirements.txt
copy sdks/python/{apache_beam/io/gcp/pubsublite/__init__.py => pyproject.toml}
(54%)
create mode 100644 website/www/site/content/en/blog/beam-2.51.0.md
