This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 3e2b9b25a42 Add GitHub Workflow Replacement for Jenkins
job_PreCommit_Java (#27999)
add 6de9565fdcd [Java][Schemas] Improve performance of
GetterBasedSchemaProvider#fromRowFunction (closes #27533) (#27534)
add 63f419726dc Add word count to BagOfWords (#28203)
add 00136b112bc Update KeyMhMapping to KeyModelMapping (#28209)
add 45998db60e9 beam metrics publish job (#28220)
add d616fc2cdcb [Go] Exclude "TestFhirIO.*" from Go PostCommit Dataflow
ARM test suite (#28215)
add 5ccee16106c Add GitHub Workflow Replacement for Jenkins
job_PreCommit_Java_Examples_Dataflow_Java17 (#28082)
add 100c06a0f4b Doc updates for 2.50.0 release (#28055)
add e5ed7aa1582 Add debug logs for updated schema in BigQueryIO (#28189)
add 5f1cc573cd3 Change calls to dockerPush to docker for multi-arch
containers (#28216)
add c360399f1a1 Add github issue link to TODO (#28230)
add 7bc5d1a99d7 SpannerIO: retry if concurrent transaction is aborted by
emulator (#28093)
add 7dfb0cebdd0 Improve Go SDK Staticcheck Compliance (#28224)
add ca0345b8acc Connect GitHub Actions builds to ge.apache.org and remote
build cache (#28212)
add c7b13f90874 adding --namespace to beam metrics gradle build (#28232)
add d359758c3ac Fix 2.50.0 release dates. (#28231)
add 93fd021e64a Added integration tests for GCSFileSystem (#28185)
add a636f25e139 [Go SDK]: Refactor avroio and parquetio Read to use fileio
abstractions (#28177)
add 51f25427270 [Python] refactor payload creation for display_data
(#28225)
add f91bb68b2e9 Add some simple annotations to Python transforms. (#28191)
No new revisions were added by this update.
Summary of changes:
.github/workflows/README.md | 4 +-
...yml => beam_PostCommit_BeamMetrics_Publish.yml} | 65 ++---
.../workflows/beam_PostCommit_Go_Dataflow_ARM.yml | 5 +
.../beam_PostCommit_Java_Examples_Dataflow_ARM.yml | 5 +
.../workflows/beam_PreCommit_CommunityMetrics.yml | 5 +
.github/workflows/beam_PreCommit_Go.yml | 5 +
.github/workflows/beam_PreCommit_GoPortable.yml | 5 +
.github/workflows/beam_PreCommit_ItFramework.yml | 5 +
...eCommit_Java_Amazon-Web-Services2_IO_Direct.yml | 5 +
...reCommit_Java_Amazon-Web-Services_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Amqp_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Azure_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Cassandra_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Cdap_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Clickhouse_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Csv_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Examples_Dataflow.yml | 5 +
...eam_PreCommit_Java_Examples_Dataflow_Java11.yml | 5 +
...am_PreCommit_Java_Examples_Dataflow_Java17.yml} | 57 ++--
.../beam_PreCommit_Java_Flink_Versions.yml | 5 +
.../beam_PreCommit_Java_HBase_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_HCatalog_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Hadoop_IO_Direct.yml | 5 +
.../workflows/beam_PreCommit_Java_IOs_Direct.yml | 5 +
.../beam_PreCommit_Java_InfluxDb_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_JDBC_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Jms_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Kinesis_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Kudu_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_MongoDb_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Mqtt_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Neo4j_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_PVR_Flink_Docker.yml | 5 +
.../beam_PreCommit_Java_Parquet_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Pulsar_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_RabbitMq_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Redis_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_SingleStore_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Snowflake_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Solr_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Spark3_Versions.yml | 5 +
.../beam_PreCommit_Java_Splunk_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Thrift_IO_Direct.yml | 5 +
.../beam_PreCommit_Java_Tika_IO_Direct.yml | 5 +
.../workflows/beam_PreCommit_Kotlin_Examples.yml | 5 +
.../workflows/beam_PreCommit_Portable_Python.yml | 5 +
.github/workflows/beam_PreCommit_Python.yml | 5 +
.github/workflows/beam_PreCommit_PythonDocker.yml | 5 +
.github/workflows/beam_PreCommit_PythonDocs.yml | 5 +
.../workflows/beam_PreCommit_PythonFormatter.yml | 5 +
.github/workflows/beam_PreCommit_PythonLint.yml | 5 +
.../workflows/beam_PreCommit_Python_Coverage.yml | 5 +
.../workflows/beam_PreCommit_Python_Dataframes.yml | 5 +
.../workflows/beam_PreCommit_Python_Examples.yml | 5 +
.../beam_PreCommit_Python_Integration.yml | 5 +
.../workflows/beam_PreCommit_Python_Runners.yml | 5 +
.../workflows/beam_PreCommit_Python_Transforms.yml | 5 +
.github/workflows/beam_PreCommit_RAT.yml | 5 +
.github/workflows/beam_PreCommit_SQL_Java11.yml | 5 +
.github/workflows/beam_PreCommit_SQL_Java17.yml | 5 +
.github/workflows/beam_PreCommit_Typescript.yml | 5 +
.github/workflows/beam_PreCommit_Website.yml | 5 +
.../workflows/beam_PreCommit_Website_Stage_GCS.yml | 5 +
.github/workflows/beam_PreCommit_Whitespace.yml | 5 +
...beam_Python_ValidatesContainer_Dataflow_ARM.yml | 5 +
.github/workflows/build_release_candidate.yml | 5 +
.github/workflows/code_completion_plugin_tests.yml | 3 +
.github/workflows/java_tests.yml | 4 +
.github/workflows/local_env_tests.yml | 5 +
.github/workflows/playground_backend_precommit.yml | 6 +
.github/workflows/playground_frontend_test.yml | 5 +
.../workflows/tour_of_beam_backend_integration.yml | 5 +
.github/workflows/tour_of_beam_frontend_test.yml | 5 +
.github/workflows/update_python_dependencies.yml | 5 +
.test-infra/metrics/build.gradle | 6 +-
CHANGES.md | 6 +-
sdks/go/pkg/beam/core/graph/fn.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 6 +-
sdks/go/pkg/beam/core/runtime/harness/datamgr.go | 3 +-
sdks/go/pkg/beam/io/avroio/avroio.go | 41 +--
sdks/go/pkg/beam/io/datastoreio/datastore.go | 10 +-
sdks/go/pkg/beam/io/parquetio/parquetio.go | 48 +---
sdks/go/pkg/beam/register/iter.go | 2 +-
.../beam/runners/prism/internal/config/config.go | 2 +-
.../pkg/beam/runners/universal/runnerlib/stage.go | 4 +-
sdks/go/pkg/beam/staticcheck.conf | 2 +-
sdks/go/pkg/beam/util/execx/exec.go | 2 +-
sdks/go/test/integration/integration.go | 8 +-
.../beam/sdk/schemas/FromRowUsingCreator.java | 320 ++++++++++++---------
sdks/java/expansion-service/container/build.gradle | 2 +-
.../beam/sdk/io/gcp/bigquery/BigQueryHelpers.java | 2 +-
.../bigquery/StorageApiWriteUnshardedRecords.java | 5 +-
.../bigquery/StorageApiWritesShardedRecords.java | 2 +
.../beam/sdk/io/gcp/bigquery/WriteTables.java | 2 +
.../apache/beam/sdk/io/gcp/spanner/SpannerIO.java | 10 +-
.../sdk/io/gcp/spanner/SpannerIOWriteTest.java | 29 +-
.../controller-container/build.gradle | 2 +-
.../pytorch_model_per_key_image_segmentation.py | 4 +-
.../io/gcp/gcsfilesystem_integration_test.py | 139 +++++++++
sdks/python/apache_beam/ml/inference/base.py | 26 +-
sdks/python/apache_beam/ml/inference/base_test.py | 62 ++--
sdks/python/apache_beam/ml/transforms/tft.py | 27 +-
sdks/python/apache_beam/ml/transforms/tft_test.py | 33 +++
sdks/python/apache_beam/transforms/display.py | 2 +-
sdks/python/apache_beam/transforms/ptransform.py | 5 +-
.../apache_beam/yaml/yaml_transform_scope_test.py | 10 +-
.../expansion-service-container/build.gradle | 2 +-
website/www/site/config.toml | 2 +-
website/www/site/content/en/blog/beam-2.50.0.md | 243 ++++++++++++++++
.../en/documentation/sdks/go-dependencies.md | 2 +-
.../en/documentation/sdks/java-dependencies.md | 2 +-
.../en/documentation/sdks/python-dependencies.md | 2 +-
.../www/site/content/en/get-started/downloads.md | 14 +-
113 files changed, 1203 insertions(+), 367 deletions(-)
copy .github/workflows/{beam_PreCommit_Go.yml =>
beam_PostCommit_BeamMetrics_Publish.yml} (68%)
copy .github/workflows/{beam_PreCommit_SQL_Java17.yml =>
beam_PreCommit_Java_Examples_Dataflow_Java17.yml} (69%)
create mode 100644
sdks/python/apache_beam/io/gcp/gcsfilesystem_integration_test.py
create mode 100644 website/www/site/content/en/blog/beam-2.50.0.md