This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 0b91ed1d432 add mention of managed iceberg read breakage (#39660)
add 111c9c35d8b Bump github/codeql-action from 4.37.5 to 4.37.6 (#39673)
add 9a03f7222c8 Bump cloud.google.com/go/bigtable from 1.51.0 to 1.52.0 in
/sdks (#39672)
add 9f2d498234a Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#39671)
add 57e1f8eb651 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#39670)
add 1a21c6183a8 fix iceberg CDC test (#39675)
add f9ca09b3183 [Spark] Support splittable DoFn self-checkpointing in
portable batch (#39331)
add 837590e5426 Fix Row.toString NPE on a null nested inside an array, map
or row (#39587)
add d0cff01a766 [BigQueryIO] Parallelize schema update integration tests
(#39622)
add 1e4c093445a [examples] Atomically publish subprocess executables
(#39621)
add 1fe64b99e8d Bump h2 from 4.3.0 to 4.4.1 in
/sdks/python/container/py314 (#39677)
add 2e48a718712 Add ml and interactive extras to quickstart-py doc (#39679)
add d3d6e484a74 add closing dependabot step (#39649)
add 0aacd0375f0 Add helpers to interact with pipeline options in boot
entrypoints (#39595)
add 1318bfe2039 Fix runner compatibility matrix (#39682)
No new revisions were added by this update.
Summary of changes:
.../beam_PostCommit_Java_PVR_Spark3_Streaming.json | 2 +-
.../beam_PostCommit_Java_PVR_Spark_Batch.json | 2 +-
...beam_PostCommit_Java_ValidatesRunner_Spark.json | 2 +-
...am_PostCommit_Python_ValidatesRunner_Spark.json | 3 +-
.../beam_PostCommit_Yaml_Xlang_Direct.json | 2 +-
.github/workflows/codeql.yml | 4 +-
CHANGES.md | 3 +-
.../beam/examples/subprocess/utils/FileUtils.java | 30 ++-
.../examples/subprocess/utils/FileUtilsTest.java | 80 +++++++
runners/spark/job-server/spark_job_server.gradle | 5 +-
.../SparkBatchPortablePipelineTranslator.java | 8 +-
.../translation/SparkExecutableStageFunction.java | 172 +++++++++++++--
.../SparkStreamingPortablePipelineTranslator.java | 4 +-
.../SparkExecutableStageFunctionTest.java | 138 +++++++++++-
scripts/ci/pr-bot/processNewPrs.ts | 20 ++
scripts/ci/pr-bot/shared/githubUtils.ts | 21 ++
sdks/go.mod | 6 +-
sdks/go.sum | 12 +-
sdks/go/container/boot.go | 40 ++--
sdks/go/container/boot_test.go | 17 +-
sdks/go/container/tools/pipeline_options.go | 218 ++++++++++++++++++
sdks/go/container/tools/pipeline_options_test.go | 243 +++++++++++++++++++++
sdks/go/pkg/beam/artifact/options.go | 48 ----
sdks/go/pkg/beam/artifact/options_test.go | 78 -------
sdks/java/container/boot.go | 4 +-
.../org/apache/beam/sdk/schemas/SchemaUtils.java | 7 +
.../apache/beam/sdk/schemas/SchemaUtilsTest.java | 43 ++++
sdks/java/io/google-cloud-platform/build.gradle | 3 +-
....java => StorageApiSinkSchemaUpdateITBase.java} | 61 ++----
...torageApiSinkSchemaUpdateWithInputSchemaIT.java | 50 +++++
...ageApiSinkSchemaUpdateWithoutInputSchemaIT.java | 51 +++++
.../python/apache_beam/options/pipeline_options.py | 1 +
.../runners/portability/spark_runner_test.py | 20 --
.../yaml/extended_tests/databases/iceberg.yaml | 3 +
sdks/python/container/boot.go | 57 +----
sdks/python/container/profiler.go | 69 ++++--
sdks/python/container/profiler_test.go | 19 +-
.../container/py314/base_image_requirements.txt | 2 +-
sdks/typescript/container/boot.go | 4 +-
.../www/site/assets/scss/_capability-matrix.scss | 123 +++--------
.../www/site/assets/scss/capability-matrix.scss | 121 +++-------
.../site/content/en/get-started/quickstart-py.md | 17 ++
.../documentation/capability-matrix-big.html | 36 +--
.../documentation/capability-matrix-single.html | 37 +---
44 files changed, 1324 insertions(+), 562 deletions(-)
create mode 100644
examples/java/src/test/java/org/apache/beam/examples/subprocess/utils/FileUtilsTest.java
delete mode 100644 sdks/go/pkg/beam/artifact/options.go
delete mode 100644 sdks/go/pkg/beam/artifact/options_test.go
rename
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/{StorageApiSinkSchemaUpdateIT.java
=> StorageApiSinkSchemaUpdateITBase.java} (94%)
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/StorageApiSinkSchemaUpdateWithInputSchemaIT.java
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/StorageApiSinkSchemaUpdateWithoutInputSchemaIT.java
