This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from ceeb5fa975b Merge pull request #40682 from
Eliaaazzz/fix/runinference-max-batch-weight
add f1ec3ac0fac [Go] Support non-default universes for GCS and Dataflow
clients (#40686)
add e18c21762a5 [Python] Infer the right type for slices of fixed-size
tuples (#40680)
add bbd5e287800 [RunInference] Honor model updates in also in the first
batch. (#40667)
add 3988ad7a6a3 Apply before set image
add fa6c8583e53 Merge pull request #40706 from
apache/fix-publish-beam-metrics
add 8cae4991fca [Java] Close GcsUtilV2's small-file performance gaps with
GcsUtilV1 (#40677)
add b54c607c4d5 move pipeline examples from blueprint to pipelines (#40615)
add 63d8acc795e [BEAM-19954] Resolve string annotations in callable type
hints (#40625)
add 5b9c5ba2b97 test: allow users to set custom Neo4j config (#40700)
add 06e4102173b [yaml] - fix spanner configs and examples (#40587)
add b4f9f3ec756 Update xgboost dependency, execute in CI (#40694)
add f3f7ad1c159 Fix prober community metrics (#40707)
add ba412b0ad7d Use with_output_types
add 5b6aa703f0a Merge pull request #40683 from apache/fix-spanner-flatmap
No new revisions were added by this update.
Summary of changes:
.../beam_PostCommit_Python_Dependency.json | 2 +-
.../trigger_files/beam_PreCommit_Python_ML.json | 2 +-
.test-infra/metrics/build.gradle | 10 +-
.../metrics/src/test/groovy/ProberTests.groovy | 91 +++++++++-
CHANGES.md | 7 +
.../apache/beam/it/neo4j/Neo4jResourceManager.java | 18 +-
.../beam/it/neo4j/Neo4jResourceManagerTest.java | 10 ++
sdks/go/pkg/beam/options/gcpopts/options.go | 67 +++++++
sdks/go/pkg/beam/options/gcpopts/universe_test.go | 120 +++++++++++++
sdks/go/pkg/beam/runners/dataflow/dataflow.go | 2 +-
.../runners/dataflow/dataflowlib/client_test.go | 91 ++++++++++
.../pkg/beam/runners/dataflow/dataflowlib/job.go | 25 +--
sdks/go/pkg/beam/util/gcsx/client_test.go | 53 ++++++
sdks/go/pkg/beam/util/gcsx/gcs.go | 27 ++-
.../sdk/extensions/gcp/options/GcsOptions.java | 4 +-
.../beam/sdk/extensions/gcp/util/GcsUtilV2.java | 125 +++++++++++--
.../sdk/extensions/gcp/util/GcsUtilV2Test.java | 198 +++++++++++++++++++--
.../SpannerReadSchemaTransformProvider.java | 12 +-
.../SpannerWriteSchemaTransformProvider.java | 8 +-
.../gcp/experimental/spannerio_read_perf_test.py | 4 +-
.../gcp/experimental/spannerio_write_perf_test.py | 4 +-
sdks/python/apache_beam/ml/inference/base.py | 56 +++---
sdks/python/apache_beam/ml/inference/base_test.py | 122 +++++++++++++
.../apache_beam/ml/inference/xgboost_inference.py | 9 +-
.../ml/inference/xgboost_inference_test.py | 4 +-
.../ml/inference/xgboost_tests_requirements.txt | 4 +-
sdks/python/apache_beam/typehints/decorators.py | 76 ++++++++
.../apache_beam/typehints/decorators_test.py | 189 ++++++++++++++++++++
sdks/python/apache_beam/typehints/opcodes.py | 33 +++-
.../typehints/trivial_inference_test.py | 17 ++
.../apache_beam/typehints/typed_pipeline_test.py | 16 +-
.../yaml/examples/testing/examples_test.py | 2 +-
.../yaml/examples/transforms/io/spanner_read.yaml | 8 +-
.../yaml/examples/transforms/io/spanner_write.yaml | 8 +-
.../ml/enrich_spanner_with_bigquery.yaml | 14 +-
.../bigquery_to_bigtable.yaml | 0
.../gcs_avro_to_cloud_bigtable.yaml | 0
.../transforms/pipelines/spanner_to_avro.yaml | 6 +-
.../transforms/pipelines/spanner_to_bigquery.yaml | 6 +-
sdks/python/setup.py | 22 ++-
sdks/python/test-suites/tox/py311/build.gradle | 9 +
sdks/python/tox.ini | 12 +-
42 files changed, 1358 insertions(+), 135 deletions(-)
create mode 100644 sdks/go/pkg/beam/options/gcpopts/universe_test.go
create mode 100644 sdks/go/pkg/beam/runners/dataflow/dataflowlib/client_test.go
create mode 100644 sdks/go/pkg/beam/util/gcsx/client_test.go
rename sdks/python/apache_beam/yaml/examples/transforms/{blueprint =>
pipelines}/bigquery_to_bigtable.yaml (100%)
rename sdks/python/apache_beam/yaml/examples/transforms/{blueprint =>
pipelines}/gcs_avro_to_cloud_bigtable.yaml (100%)
