This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from d8d4cfc3e11 Updated All Externally Visible Logs/Docs from Runner V2 to
Portable Runner (#38532)
add 3d68e9df172 Bump github.com/aws/aws-sdk-go-v2 from 1.41.7 to 1.41.8 in
/sdks (#38740)
add dc3b2ccf8e3 Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks
(#38737)
add 09a1e60fa38 fix race condition in sdb-operator (#38698)
add 5702872d9ae Disable build isolation for pip by default. (#38700)
add 07222b4dac6 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#38741)
add 0a7df5c8ba4 Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#38738)
add d9f07c5f6aa Bump setup gradle to allowlisted v6.1.0 (#38745)
add 5a5ef0cc02a Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#38739)
add 6fba3cb34b2 Implement MLTransform One-Hot Encoding benchmark pipeline
(#38404)
add 2b5c1131af3 [yaml] - mongodb write normalization (#38376)
add f771827d9f1 Disable gRPC fork support in
PortableRunnerTestWithSubprocesses (#38744)
add cbc2c21edad Fix flaky
TestDataSampler/GetSamplesForPCollectionsTooManySamples (#38736)
add 44a2ff6146c Re-enable call-args check in yaml_io.py (#38730)
add c31f2327041 Fix Reshuffle handling in Prism to recursively remove
nested sub-transforms (#38735)
No new revisions were added by this update.
Summary of changes:
.../actions/setup-environment-action/action.yml | 2 +-
.../beam_Inference_Python_Benchmarks_Dataflow.yml | 13 +
.../beam_PerformanceTests_SingleStoreIO.yml | 2 +-
.../beam_PostCommit_Java_SingleStoreIO_IT.yml | 2 +-
...ataflow_MLTransform_One_Hot_Encoding_Batch.txt} | 18 +-
.test-infra/tools/refresh_looker_metrics.py | 1 +
sdks/go.mod | 32 +--
sdks/go.sum | 64 ++---
.../pkg/beam/core/runtime/exec/datasampler_test.go | 13 +-
.../beam/runners/prism/internal/handlerunner.go | 4 +-
.../runners/prism/internal/handlerunner_test.go | 78 ++++++
sdks/java/io/expansion-service/build.gradle | 1 +
.../apache/beam/sdk/io/mongodb/MongoDbUtils.java | 74 ++++++
.../MongoDbWriteSchemaTransformConfiguration.java | 85 +++++++
.../MongoDbWriteSchemaTransformProvider.java | 168 +++++++++++++
.../beam/sdk/io/mongodb/MongoDbUtilsTest.java | 135 +++++++++++
.../MongoDbWriteSchemaTransformProviderTest.java | 166 +++++++++++++
.../ml_transform/mltransform_one_hot_encoding.py | 266 +++++++++++++++++++++
.../mltransform_one_hot_encoding_test.py | 259 ++++++++++++++++++++
.../mltransform_tests_requirements.txt} | 15 +-
.../runners/portability/portable_runner_test.py | 32 +--
.../mltransform_one_hot_encoding_benchmark.py | 197 +++++++++++++++
sdks/python/apache_beam/yaml/integration_tests.py | 50 ++++
sdks/python/apache_beam/yaml/standard_io.yaml | 19 ++
.../yaml/tests/{text.yaml => mongodb.yaml} | 35 ++-
sdks/python/apache_beam/yaml/yaml_io.py | 54 ++++-
sdks/python/container/boot.go | 10 +-
sdks/standard_external_transforms.yaml | 32 ++-
website/www/site/content/en/performance/_index.md | 1 +
.../_index.md | 22 +-
website/www/site/data/performance.yaml | 17 ++
31 files changed, 1737 insertions(+), 130 deletions(-)
copy
.github/workflows/load-tests-pipeline-options/{beam_Inference_Python_Benchmarks_Dataflow_Pytorch_Language_Modeling_Bert_Large_Uncased.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_MLTransform_One_Hot_Encoding_Batch.txt}
(73%)
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/handlerunner_test.go
create mode 100644
sdks/java/io/mongodb/src/main/java/org/apache/beam/sdk/io/mongodb/MongoDbUtils.java
create mode 100644
sdks/java/io/mongodb/src/main/java/org/apache/beam/sdk/io/mongodb/MongoDbWriteSchemaTransformConfiguration.java
create mode 100644
sdks/java/io/mongodb/src/main/java/org/apache/beam/sdk/io/mongodb/MongoDbWriteSchemaTransformProvider.java
create mode 100644
sdks/java/io/mongodb/src/test/java/org/apache/beam/sdk/io/mongodb/MongoDbUtilsTest.java
create mode 100644
sdks/java/io/mongodb/src/test/java/org/apache/beam/sdk/io/mongodb/MongoDbWriteSchemaTransformProviderTest.java
create mode 100644
sdks/python/apache_beam/examples/ml_transform/mltransform_one_hot_encoding.py
create mode 100644
sdks/python/apache_beam/examples/ml_transform/mltransform_one_hot_encoding_test.py
copy
sdks/python/apache_beam/ml/{inference/table_row_inference_requirements.txt =>
transforms/mltransform_tests_requirements.txt} (70%)
create mode 100644
sdks/python/apache_beam/testing/benchmarks/inference/mltransform_one_hot_encoding_benchmark.py
copy sdks/python/apache_beam/yaml/tests/{text.yaml => mongodb.yaml} (62%)
copy website/www/site/content/en/performance/{pytorchresnet152 =>
mltransformonehot}/_index.md (50%)
