This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/pip/sdks/python/container/ml/py310/torch-2.12.0
in repository https://gitbox.apache.org/repos/asf/beam.git
discard 878a69d4cba Bump torch from 2.7.1 to 2.12.0 in
/sdks/python/container/ml/py310
add 6ed0635429a Spanner: Extend SpannerIO to support Spanner Omni mTLS
setup (#38928)
add 378e10de4ea ClickHouseIO: Add DateTime64 support for sub-second
timestamp precision (#38510)
add 98e29d99fcd Revert "Upgrade expansion jar to java17 (#38931)" (#38965)
add bde545f91e4 Add support for STDDEV_POP and STDDEV_SAMP in VarianceFn
(#38871)
add 77348121ee9 Update BEAM_DEV_SDK_CONTAINER_TAG version (#38963)
add a996a9fb610 Bump protobufjs from 8.4.0 to 8.6.0 in /sdks/typescript
(#38968)
add 2c4822959e1 Bump form-data from 2.5.5 to 2.5.6 in /sdks/typescript
(#38967)
add b7bc937f592 Use Flink 2.0 for load tests (#38279)
add c0cc8897f4a Bump cloud.google.com/go/spanner from 1.91.0 to 1.92.0 in
/sdks (#38976)
add 468ae40dc8e Fix AsyncWrapperTest timeout and flakiness issues. (#38970)
add e55a1f7399b fix failure in opentelemetry-gcp-auth-extension jar
(#38938)
add 33b34574b3c Bump jsonpickle upper bound. (#38769)
add 2c53494f735 [Dataflow Java] Clarify which portions of
DataflowWorkerLoggingOptions are deprecated (#38960)
add 0bc785253eb Fix WriteToPubSub to pass ordering_key to publish() method
(#37345)
add d032f0e3ef4 Add drain support for Dataflow and Flink (#38786)
add c608b4da8de Bump google.golang.org/api from 0.284.0 to 0.285.0 in
/sdks (#38997)
add 9765e29de68 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#38998)
add 6ccd0c9c861 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#38999)
add b9342767cc5 fix sentence (#38989)
add 597f92530f1 address DOM text reinterpreted as HTML alert (#38949)
add 56d4ffdab31 Align gcpauth extension implementation with ability to
turn it off easily while still being added as dependency.
add 2802de39b2e Merge pull request #38846: [OpenTelemetry] Add turning off
to gcpauth extension
add ee92a553e5d Disable public IP for Dataflow Python and Go Validate
runner tests (#38990)
add 1c182507444 Add support for Apache Flink 2.1.3 (#38961)
add 1d703fe904f Make ModelManager import more robust (#38936)
add 849fcf89c81 [Beam SQL Shell] Add Iceberg deps when using icebergio
(#38994)
add a3f9e0e7d96 Add publish_time_field to ReadFromPubSub YAML transform
(#38985)
add 15d00559d75 Bump cloud.google.com/go/bigtable from 1.49.0 to 1.50.0 in
/sdks (#39012)
add 5c34e1c1c85 Exclude tests for batch-dataset (#39014)
add 9e465a7cfd7 fix parsing error for typescript (#38898)
add c81059fb246 Drop Flink 1.17,1.18 support (#39006)
add 466989d50a4 cancel user code with interruption after timeout (#39018)
add 09c962c4aef Fix Milvus ML PreCommit xdist, container startup (#39007)
add b4e023afece Bump nodemailer from 8.0.5 to 9.0.1 in
/scripts/ci/issue-report (#39019)
add 17bed431e05 remove shardedKey (#39024)
add 63bcd3dd2b5 Validate Project of staging bucket (#39008)
add 8ba04741b47 Sanitize logging in FanOutStreamingEngineWorkerHarness
(#39029)
add 974ad17b60d Increase CallTest sleep durations to keep test from being
flaky due to timeout not being observed. (#39016)
add caba399f96e [Dataflow Java] Fix incorrect warning log when specifying
logger override. (#39034)
add 1df57236fe3 Bump github.com/moby/moby/api from 1.54.2 to 1.55.0 in
/sdks (#39031)
add fc370c9fdc8 [FnApi Java] Add support for separate named data streams
to provide bundle isolation (#38863)
add 630a34c3bfa Bump github.com/moby/moby/client from 0.4.1 to 0.5.0 in
/sdks (#39032)
add a21ca397b42 [Iceberg AddFiles] Add NameMapping when creating table
(#39022)
add 5334dc1d92a Add Flink 2.2.1 runner support (#38980)
add 06aa37bdffd use proper table naming in iceberg sql (#39035)
add e948ef62041 Roll forward io expansion service to Java17 (#38974)
add eaba570c569 Bump github.com/golang-cz/devslog from 0.0.16 to 0.0.17 in
/sdks (#39054)
add 54231e89266 try to fix forward tests for java 17 (#39058)
add 9aed894f5d4 Update pandas version upper bound to support python 3.14
(#39056)
add 9868954ce8c Fix playground precommit test failure (#39062)
add c2474960db7 [yaml] - expand jinja method (#38547)
add d031bddfdc9 Bump actions/checkout from 6 to 7 (#39033)
add 117bb893ca8 Bump google.golang.org/api from 0.285.0 to 0.286.0 in
/sdks (#39068)
add 9a9f48b9542 Fix Flink 2.1+ dependency resolution (#39061)
add c77b2d40626 Update Python Dependencies (#39070)
add 3bc43cde7e8 Bump torch from 2.7.1 to 2.12.1 in
/sdks/python/container/ml/py310
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (878a69d4cba)
\
N -- N -- N
refs/heads/dependabot/pip/sdks/python/container/ml/py310/torch-2.12.0
(3bc43cde7e8)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../test-properties.json | 2 +-
.../actions/setup-environment-action/action.yml | 4 +-
.../IO_Iceberg_Integration_Tests.json | 2 +-
.github/trigger_files/beam_PostCommit_Go.json | 2 +-
.../beam_PostCommit_Java_DataflowV2.json | 2 +-
.../beam_PostCommit_Java_Nexmark_Flink.json | 2 +-
....json => beam_PostCommit_Java_Tpcds_Flink.json} | 0
...ostCommit_Java_ValidatesRunner_Dataflow_V2.json | 2 +-
...beam_PostCommit_Java_ValidatesRunner_Spark.json | 18 +-
.github/trigger_files/beam_PostCommit_Python.json | 4 +-
...PostCommit_Python_ValidatesRunner_Dataflow.json | 2 +-
.../trigger_files/beam_PreCommit_Python_ML.json | 2 +-
.github/workflows/IO_Iceberg_Integration_Tests.yml | 2 +-
.../IO_Iceberg_Integration_Tests_Dataflow.yml | 2 +-
..._Iceberg_Managed_Integration_Tests_Dataflow.yml | 2 +-
.github/workflows/IO_Iceberg_Performance_Tests.yml | 2 +-
.github/workflows/IO_Iceberg_Unit_Tests.yml | 2 +-
.github/workflows/assign_milestone.yml | 2 +-
.github/workflows/beam_CancelStaleDataflowJobs.yml | 2 +-
.../workflows/beam_CleanUpDataprocResources.yml | 2 +-
.github/workflows/beam_CleanUpGCPResources.yml | 2 +-
.../workflows/beam_CleanUpPrebuiltSDKImages.yml | 2 +-
.../workflows/beam_CloudML_Benchmarks_Dataflow.yml | 2 +-
.../beam_IODatastoresCredentialsRotation.yml | 2 +-
.../beam_Inference_Python_Benchmarks_Dataflow.yml | 2 +-
.../beam_Infrastructure_PolicyEnforcer.yml | 2 +-
.../beam_Infrastructure_SecurityLogging.yml | 2 +-
.../beam_Infrastructure_ServiceAccountKeys.yml | 2 +-
.../beam_Infrastructure_UsersPermissions.yml | 2 +-
.github/workflows/beam_Java_JMH.yml | 2 +-
.../beam_Java_LoadTests_Combine_Smoke.yml | 2 +-
.../beam_LoadTests_Go_CoGBK_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_CoGBK_Flink_batch.yml | 6 +-
.../beam_LoadTests_Go_Combine_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_Combine_Flink_Batch.yml | 6 +-
.../beam_LoadTests_Go_GBK_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_GBK_Flink_Batch.yml | 6 +-
.../beam_LoadTests_Go_ParDo_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_ParDo_Flink_Batch.yml | 6 +-
.../beam_LoadTests_Go_SideInput_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_SideInput_Flink_Batch.yml | 6 +-
.../beam_LoadTests_Java_CoGBK_Dataflow_Batch.yml | 2 +-
...eam_LoadTests_Java_CoGBK_Dataflow_Streaming.yml | 2 +-
...s_Java_CoGBK_Dataflow_V2_Batch_JavaVersions.yml | 2 +-
...va_CoGBK_Dataflow_V2_Streaming_JavaVersions.yml | 2 +-
...s_Java_CoGBK_SparkStructuredStreaming_Batch.yml | 2 +-
.../beam_LoadTests_Java_Combine_Dataflow_Batch.yml | 2 +-
...m_LoadTests_Java_Combine_Dataflow_Streaming.yml | 2 +-
...Java_Combine_SparkStructuredStreaming_Batch.yml | 2 +-
.../beam_LoadTests_Java_GBK_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Java_GBK_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Java_GBK_Dataflow_V2_Batch.yml | 2 +-
...LoadTests_Java_GBK_Dataflow_V2_Batch_Java17.yml | 2 +-
...am_LoadTests_Java_GBK_Dataflow_V2_Streaming.yml | 2 +-
...Tests_Java_GBK_Dataflow_V2_Streaming_Java17.yml | 2 +-
.../workflows/beam_LoadTests_Java_GBK_Smoke.yml | 2 +-
...sts_Java_GBK_SparkStructuredStreaming_Batch.yml | 2 +-
.../beam_LoadTests_Java_ParDo_Dataflow_Batch.yml | 2 +-
...eam_LoadTests_Java_ParDo_Dataflow_Streaming.yml | 2 +-
...s_Java_ParDo_Dataflow_V2_Batch_JavaVersions.yml | 2 +-
...va_ParDo_Dataflow_V2_Streaming_JavaVersions.yml | 2 +-
...s_Java_ParDo_SparkStructuredStreaming_Batch.yml | 2 +-
.github/workflows/beam_LoadTests_Java_PubsubIO.yml | 2 +-
.../beam_LoadTests_Python_CoGBK_Dataflow_Batch.yml | 2 +-
...m_LoadTests_Python_CoGBK_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_CoGBK_Flink_Batch.yml | 6 +-
...eam_LoadTests_Python_Combine_Dataflow_Batch.yml | 2 +-
...LoadTests_Python_Combine_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_Combine_Flink_Batch.yml | 6 +-
...am_LoadTests_Python_Combine_Flink_Streaming.yml | 6 +-
...LoadTests_Python_FnApiRunner_Microbenchmark.yml | 2 +-
.../beam_LoadTests_Python_GBK_Dataflow_Batch.yml | 2 +-
...eam_LoadTests_Python_GBK_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_GBK_Flink_Batch.yml | 6 +-
...adTests_Python_GBK_reiterate_Dataflow_Batch.yml | 2 +-
...sts_Python_GBK_reiterate_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_ParDo_Dataflow_Batch.yml | 2 +-
...m_LoadTests_Python_ParDo_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_ParDo_Flink_Batch.yml | 6 +-
...beam_LoadTests_Python_ParDo_Flink_Streaming.yml | 6 +-
...m_LoadTests_Python_SideInput_Dataflow_Batch.yml | 2 +-
.github/workflows/beam_LoadTests_Python_Smoke.yml | 2 +-
.../workflows/beam_MetricsCredentialsRotation.yml | 2 +-
.github/workflows/beam_Metrics_Report.yml | 2 +-
.../workflows/beam_PerformanceTests_AvroIOIT.yml | 2 +-
.../beam_PerformanceTests_AvroIOIT_HDFS.yml | 2 +-
...PerformanceTests_BigQueryIO_Batch_Java_Avro.yml | 2 +-
...PerformanceTests_BigQueryIO_Batch_Java_Json.yml | 2 +-
..._PerformanceTests_BigQueryIO_Streaming_Java.yml | 2 +-
...eam_PerformanceTests_BiqQueryIO_Read_Python.yml | 2 +-
...formanceTests_BiqQueryIO_Write_Python_Batch.yml | 2 +-
.github/workflows/beam_PerformanceTests_Cdap.yml | 2 +-
.../beam_PerformanceTests_Compressed_TextIOIT.yml | 2 +-
...m_PerformanceTests_Compressed_TextIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_HadoopFormat.yml | 2 +-
.github/workflows/beam_PerformanceTests_JDBC.yml | 2 +-
.../workflows/beam_PerformanceTests_Kafka_IO.yml | 2 +-
.../beam_PerformanceTests_ManyFiles_TextIOIT.yml | 2 +-
...am_PerformanceTests_ManyFiles_TextIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_MongoDBIO_IT.yml | 2 +-
.../beam_PerformanceTests_ParquetIOIT.yml | 2 +-
.../beam_PerformanceTests_ParquetIOIT_HDFS.yml | 2 +-
...erformanceTests_PubsubIOIT_Python_Streaming.yml | 2 +-
...m_PerformanceTests_SQLBigQueryIO_Batch_Java.yml | 2 +-
.../beam_PerformanceTests_SingleStoreIO.yml | 2 +-
..._PerformanceTests_SpannerIO_Read_2GB_Python.yml | 2 +-
...manceTests_SpannerIO_Write_2GB_Python_Batch.yml | 2 +-
.../beam_PerformanceTests_SparkReceiver_IO.yml | 2 +-
.../beam_PerformanceTests_TFRecordIOIT.yml | 2 +-
.../beam_PerformanceTests_TFRecordIOIT_HDFS.yml | 2 +-
.../workflows/beam_PerformanceTests_TextIOIT.yml | 2 +-
.../beam_PerformanceTests_TextIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_TextIOIT_Python.yml | 2 +-
...PerformanceTests_WordCountIT_PythonVersions.yml | 2 +-
.../workflows/beam_PerformanceTests_XmlIOIT.yml | 2 +-
.../beam_PerformanceTests_XmlIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_xlang_KafkaIO_Python.yml | 7 +-
.github/workflows/beam_Playground_CI_Nightly.yml | 2 +-
.github/workflows/beam_Playground_Precommit.yml | 4 +-
.github/workflows/beam_PostCommit_Go.yml | 2 +-
.../workflows/beam_PostCommit_Go_Dataflow_ARM.yml | 2 +-
.github/workflows/beam_PostCommit_Go_VR_Flink.yml | 2 +-
.github/workflows/beam_PostCommit_Go_VR_Spark.yml | 2 +-
.github/workflows/beam_PostCommit_Java.yml | 2 +-
.../beam_PostCommit_Java_Avro_Versions.yml | 2 +-
.../beam_PostCommit_Java_BigQueryEarlyRollout.yml | 2 +-
.../workflows/beam_PostCommit_Java_DataflowV1.yml | 2 +-
.../workflows/beam_PostCommit_Java_DataflowV2.yml | 2 +-
.../beam_PostCommit_Java_Examples_Dataflow.yml | 2 +-
.../beam_PostCommit_Java_Examples_Dataflow_ARM.yml | 2 +-
...beam_PostCommit_Java_Examples_Dataflow_Java.yml | 2 +-
.../beam_PostCommit_Java_Examples_Dataflow_V2.yml | 2 +-
...m_PostCommit_Java_Examples_Dataflow_V2_Java.yml | 2 +-
.../beam_PostCommit_Java_Examples_Direct.yml | 2 +-
.../beam_PostCommit_Java_Examples_Flink.yml | 4 +-
.../beam_PostCommit_Java_Examples_Spark.yml | 2 +-
.../beam_PostCommit_Java_Hadoop_Versions.yml | 2 +-
.../beam_PostCommit_Java_IO_Performance_Tests.yml | 4 +-
.../beam_PostCommit_Java_InfluxDbIO_IT.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Dataflow.yml | 2 +-
...beam_PostCommit_Java_Jpms_Dataflow_Versions.yml | 2 +-
.../workflows/beam_PostCommit_Java_Jpms_Direct.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Direct_Versions.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Flink_Java11.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Spark_Java11.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Dataflow.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Dataflow_V2.yml | 2 +-
...am_PostCommit_Java_Nexmark_Dataflow_V2_Java.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Direct.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Flink.yml | 7 +-
.../beam_PostCommit_Java_Nexmark_Spark.yml | 2 +-
.../beam_PostCommit_Java_PVR_Flink_Batch.yml | 4 +-
.../beam_PostCommit_Java_PVR_Flink_Streaming.yml | 6 +-
.../beam_PostCommit_Java_PVR_Spark3_Streaming.yml | 2 +-
.../beam_PostCommit_Java_PVR_Spark4_Batch.yml | 2 +-
.../beam_PostCommit_Java_PVR_Spark4_Streaming.yml | 2 +-
.../beam_PostCommit_Java_PVR_Spark_Batch.yml | 2 +-
.../beam_PostCommit_Java_SingleStoreIO_IT.yml | 2 +-
.../beam_PostCommit_Java_Tpcds_Dataflow.yml | 2 +-
.../workflows/beam_PostCommit_Java_Tpcds_Flink.yml | 4 +-
.../workflows/beam_PostCommit_Java_Tpcds_Spark.yml | 2 +-
...am_PostCommit_Java_ValidatesRunner_Dataflow.yml | 2 +-
..._Java_ValidatesRunner_Dataflow_JavaVersions.yml | 2 +-
...mit_Java_ValidatesRunner_Dataflow_Streaming.yml | 2 +-
...a_ValidatesRunner_Dataflow_Streaming_Engine.yml | 2 +-
...atesRunner_Dataflow_Streaming_TagEncodingV2.yml | 2 +-
...PostCommit_Java_ValidatesRunner_Dataflow_V2.yml | 2 +-
..._Java_ValidatesRunner_Dataflow_V2_Streaming.yml | 2 +-
...beam_PostCommit_Java_ValidatesRunner_Direct.yml | 2 +-
...it_Java_ValidatesRunner_Direct_JavaVersions.yml | 2 +-
.../beam_PostCommit_Java_ValidatesRunner_Flink.yml | 6 +-
.../beam_PostCommit_Java_ValidatesRunner_Spark.yml | 2 +-
...beam_PostCommit_Java_ValidatesRunner_Spark4.yml | 2 +-
...va_ValidatesRunner_SparkStructuredStreaming.yml | 2 +-
...am_PostCommit_Java_ValidatesRunner_Twister2.yml | 2 +-
.../beam_PostCommit_Java_ValidatesRunner_ULR.yml | 2 +-
.github/workflows/beam_PostCommit_Javadoc.yml | 2 +-
.../beam_PostCommit_PortableJar_Flink.yml | 2 +-
.../beam_PostCommit_PortableJar_Spark.yml | 2 +-
.github/workflows/beam_PostCommit_Python.yml | 2 +-
.github/workflows/beam_PostCommit_Python_Arm.yml | 2 +-
.../beam_PostCommit_Python_Dependency.yml | 2 +-
.../beam_PostCommit_Python_Examples_Dataflow.yml | 2 +-
.../beam_PostCommit_Python_Examples_Direct.yml | 2 +-
.../beam_PostCommit_Python_Examples_Flink.yml | 2 +-
.../beam_PostCommit_Python_Examples_Spark.yml | 2 +-
.../beam_PostCommit_Python_MongoDBIO_IT.yml | 2 +-
.../beam_PostCommit_Python_Nexmark_Direct.yml | 2 +-
.../beam_PostCommit_Python_Portable_Flink.yml | 2 +-
...stCommit_Python_ValidatesContainer_Dataflow.yml | 2 +-
..._Python_ValidatesContainer_Dataflow_With_RC.yml | 2 +-
..._PostCommit_Python_ValidatesRunner_Dataflow.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Flink.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Spark.yml | 2 +-
.../workflows/beam_PostCommit_Python_Versions.yml | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Dataflow.yml | 6 +-
.../beam_PostCommit_Python_Xlang_Gcp_Direct.yml | 7 +-
.../beam_PostCommit_Python_Xlang_IO_Dataflow.yml | 6 +-
.../beam_PostCommit_Python_Xlang_IO_Direct.yml | 9 +-
.github/workflows/beam_PostCommit_SQL.yml | 2 +-
.../beam_PostCommit_TransformService_Direct.yml | 9 +-
.github/workflows/beam_PostCommit_Website_Test.yml | 2 +-
.github/workflows/beam_PostCommit_XVR_Direct.yml | 6 +-
.github/workflows/beam_PostCommit_XVR_Flink.yml | 8 +-
.../beam_PostCommit_XVR_GoUsingJava_Dataflow.yml | 6 +-
...eam_PostCommit_XVR_JavaUsingPython_Dataflow.yml | 6 +-
..._PostCommit_XVR_PythonUsingJavaSQL_Dataflow.yml | 6 +-
...eam_PostCommit_XVR_PythonUsingJava_Dataflow.yml | 6 +-
.github/workflows/beam_PostCommit_XVR_Spark3.yml | 6 +-
.../beam_PostCommit_Yaml_Xlang_Direct.yml | 8 +-
.../workflows/beam_PostRelease_NightlySnapshot.yml | 2 +-
.../workflows/beam_PreCommit_CommunityMetrics.yml | 2 +-
.../workflows/beam_PreCommit_Flink_Container.yml | 8 +-
.github/workflows/beam_PreCommit_GHA.yml | 2 +-
.github/workflows/beam_PreCommit_Go.yml | 2 +-
.github/workflows/beam_PreCommit_GoPortable.yml | 2 +-
.github/workflows/beam_PreCommit_GoPrism.yml | 2 +-
.github/workflows/beam_PreCommit_ItFramework.yml | 2 +-
.github/workflows/beam_PreCommit_Java.yml | 2 +-
...eCommit_Java_Amazon-Web-Services2_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Amqp_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Azure_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Cassandra_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Cdap_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Clickhouse_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Csv_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Datadog_IO_Direct.yml | 2 +-
.github/workflows/beam_PreCommit_Java_Dataflow.yml | 2 +-
.../beam_PreCommit_Java_Debezium_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Delta_IO_Direct.yml | 2 +-
...beam_PreCommit_Java_ElasticSearch_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Examples_Dataflow.yml | 2 +-
...eam_PreCommit_Java_Examples_Dataflow_Java21.yml | 2 +-
...Commit_Java_File-schema-transform_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Flink_Versions.yml | 2 +-
.../beam_PreCommit_Java_GCP_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Google-ads_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_HBase_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_HCatalog_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Hadoop_IO_Direct.yml | 2 +-
.../workflows/beam_PreCommit_Java_IOs_Direct.yml | 2 +-
.../beam_PreCommit_Java_InfluxDb_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_JDBC_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Jms_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Kafka_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Kudu_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_MongoDb_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Mqtt_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Neo4j_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_PVR_Flink_Batch.yml | 4 +-
.../beam_PreCommit_Java_PVR_Flink_Docker.yml | 4 +-
.../beam_PreCommit_Java_PVR_Prism_Loopback.yml | 2 +-
.../beam_PreCommit_Java_Parquet_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Pulsar_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_RabbitMq_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Redis_IO_Direct.yml | 2 +-
...am_PreCommit_Java_RequestResponse_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_SingleStore_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Snowflake_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Solace_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Solr_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Spark_Versions.yml | 2 +-
.../beam_PreCommit_Java_Splunk_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Thrift_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Tika_IO_Direct.yml | 2 +-
.../workflows/beam_PreCommit_Kotlin_Examples.yml | 2 +-
.../workflows/beam_PreCommit_Portable_Python.yml | 2 +-
.github/workflows/beam_PreCommit_Prism_Python.yml | 2 +-
.github/workflows/beam_PreCommit_Python.yml | 2 +-
.github/workflows/beam_PreCommit_PythonDocker.yml | 2 +-
.github/workflows/beam_PreCommit_PythonDocs.yml | 2 +-
.../workflows/beam_PreCommit_PythonFormatter.yml | 2 +-
.github/workflows/beam_PreCommit_PythonLint.yml | 2 +-
.../workflows/beam_PreCommit_Python_Coverage.yml | 2 +-
.../workflows/beam_PreCommit_Python_Dataframes.yml | 2 +-
.github/workflows/beam_PreCommit_Python_Dill.yml | 2 +-
.../workflows/beam_PreCommit_Python_Examples.yml | 2 +-
.../beam_PreCommit_Python_Integration.yml | 2 +-
.github/workflows/beam_PreCommit_Python_ML.yml | 2 +-
.../workflows/beam_PreCommit_Python_PVR_Flink.yml | 2 +-
.../workflows/beam_PreCommit_Python_Runners.yml | 2 +-
.../workflows/beam_PreCommit_Python_Transforms.yml | 2 +-
.github/workflows/beam_PreCommit_RAT.yml | 2 +-
.github/workflows/beam_PreCommit_SQL.yml | 2 +-
.github/workflows/beam_PreCommit_SQL_Java17.yml | 2 +-
.github/workflows/beam_PreCommit_Spotless.yml | 2 +-
.github/workflows/beam_PreCommit_Typescript.yml | 2 +-
.github/workflows/beam_PreCommit_Website.yml | 2 +-
.../workflows/beam_PreCommit_Website_Stage_GCS.yml | 2 +-
.github/workflows/beam_PreCommit_Whitespace.yml | 2 +-
.../beam_PreCommit_Xlang_Generated_Transforms.yml | 8 +-
.../workflows/beam_PreCommit_Yaml_Xlang_Direct.yml | 7 +-
.github/workflows/beam_Prober_CommunityMetrics.yml | 2 +-
.github/workflows/beam_Publish_BeamMetrics.yml | 2 +-
.../workflows/beam_Publish_Beam_SDK_Snapshots.yml | 7 +-
.../workflows/beam_Publish_Docker_Snapshots.yml | 6 +-
.github/workflows/beam_Publish_Website.yml | 4 +-
.../beam_Python_CostBenchmarks_Dataflow.yml | 2 +-
...beam_Python_ValidatesContainer_Dataflow_ARM.yml | 2 +-
.github/workflows/beam_Release_NightlySnapshot.yml | 2 +-
.../beam_Release_Python_NightlySnapshot.yml | 2 +-
.../workflows/beam_StressTests_Java_BigQueryIO.yml | 2 +-
.../workflows/beam_StressTests_Java_BigTableIO.yml | 2 +-
.../workflows/beam_StressTests_Java_KafkaIO.yml | 2 +-
.../workflows/beam_StressTests_Java_PubSubIO.yml | 2 +-
.../workflows/beam_StressTests_Java_SpannerIO.yml | 2 +-
.github/workflows/build_release_candidate.yml | 24 +-
.github/workflows/build_runner_image.yml | 2 +-
.github/workflows/build_wheels.yml | 6 +-
.github/workflows/cancel.yml | 2 +-
.github/workflows/code_completion_plugin_tests.yml | 4 +-
.github/workflows/codeql.yml | 2 +-
.github/workflows/cut_release_branch.yml | 4 +-
.github/workflows/dask_runner_tests.yml | 4 +-
.../workflows/deploy_release_candidate_pypi.yaml | 2 +-
.github/workflows/finalize_release.yml | 6 +-
.github/workflows/flaky_test_detection.yml | 2 +-
.github/workflows/git_tag_released_version.yml | 2 +-
.github/workflows/go_tests.yml | 2 +-
.github/workflows/issue-tagger.yml | 2 +-
.github/workflows/java_tests.yml | 4 +-
.github/workflows/local_env_tests.yml | 4 +-
.github/workflows/playground_frontend_test.yml | 2 +-
.github/workflows/pr-bot-new-prs.yml | 2 +-
.github/workflows/pr-bot-pr-updates.yml | 2 +-
.github/workflows/pr-bot-prs-needing-attention.yml | 2 +-
.github/workflows/publish_github_release_notes.yml | 4 +-
.github/workflows/python_dependency_tests.yml | 2 +-
.github/workflows/python_tests.yml | 8 +-
.github/workflows/refresh_looker_metrics.yml | 2 +-
.github/workflows/reportGenerator.yml | 2 +-
.../republish_released_docker_containers.yml | 2 +-
.github/workflows/run_perf_alert_tool.yml | 2 +-
.../workflows/run_rc_validation_go_wordcount.yml | 2 +-
.../run_rc_validation_java_mobile_gaming.yml | 2 +-
.../run_rc_validation_java_quickstart.yml | 4 +-
.../run_rc_validation_python_mobile_gaming.yml | 2 +-
.../workflows/run_rc_validation_python_yaml.yml | 2 +-
.github/workflows/tour_of_beam_backend.yml | 2 +-
.../workflows/tour_of_beam_backend_integration.yml | 2 +-
.github/workflows/tour_of_beam_frontend_test.yml | 2 +-
.github/workflows/typescript_tests.yml | 18 +-
.github/workflows/update_python_dependencies.yml | 4 +-
.test-infra/dataproc/flink_cluster.sh | 6 +-
.test-infra/validate-runner/build.gradle | 13 +
CHANGES.md | 5 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 43 +++-
examples/java/common.gradle | 2 +
gradle.properties | 2 +-
.../beam/model/fn_execution/v1/beam_fn_api.proto | 38 ++-
.../beam/model/pipeline/v1/beam_runner_api.proto | 4 +
.../life_cycle/life_cycle_setuper_test.go | 3 +-
release/build.gradle.kts | 2 +-
runners/flink/1.17/build.gradle | 25 --
runners/flink/1.18/build.gradle | 25 --
.../flink/streaming/MemoryStateBackendWrapper.java | 80 ------
.../runners/flink/streaming/StreamSources.java | 61 -----
runners/flink/{2.0 => 2.1}/build.gradle | 11 +-
.../job-server-container/build.gradle | 0
.../flink/{1.17 => 2.1}/job-server/build.gradle | 9 +-
runners/flink/{2.0 => 2.2}/build.gradle | 26 +-
.../job-server-container/build.gradle | 0
.../flink/{1.18 => 2.2}/job-server/build.gradle | 9 +-
.../runners/flink/FlinkExecutionEnvironments.java | 4 +-
.../wrappers/streaming/DoFnOperator.java | 2 +-
.../runners/flink/FlinkPipelineOptionsTest.java | 16 +-
runners/flink/job-server/flink_job_server.gradle | 2 +-
.../runners/flink/FlinkDetachedRunnerResult.java | 60 ++++-
.../beam/runners/flink/FlinkRunnerResult.java | 6 +
.../beam/runners/flink/FlinkRunnerResultTest.java | 92 +++++++
.../flink/streaming/MemoryStateBackendWrapper.java | 28 ++-
.../runners/flink/streaming/StreamSources.java | 7 +
.../beam/runners/dataflow/DataflowPipelineJob.java | 67 +++--
.../options/DataflowWorkerLoggingOptions.java | 56 ++++-
.../runners/dataflow/DataflowPipelineJobTest.java | 46 ++++
.../logging/DataflowWorkerLoggingInitializer.java | 12 +-
.../FanOutStreamingEngineWorkerHarness.java | 7 +-
.../DataflowWorkerLoggingInitializerTest.java | 44 +++-
.../fnexecution/control/SdkHarnessClient.java | 2 +-
.../runners/fnexecution/data/FnDataService.java | 3 +-
.../runners/fnexecution/data/GrpcDataService.java | 13 +-
.../fnexecution/data/GrpcDataServiceTest.java | 2 +-
scripts/beam-sql.sh | 73 +++++-
scripts/ci/issue-report/package-lock.json | 14 +-
scripts/ci/issue-report/package.json | 2 +-
sdks/go.mod | 18 +-
sdks/go.sum | 36 +--
sdks/go/examples/wasm/README.md | 6 +-
sdks/go/test/build.gradle | 5 +-
.../java/org/apache/beam/sdk/PipelineResult.java | 13 +
.../sdk/fn/data/BeamFnDataGrpcMultiplexer.java | 2 +-
.../sdk/fn/data/BeamFnDataOutboundAggregator.java | 131 +++++++---
.../beam/sdk/util/construction/Environments.java | 1 +
.../fn/data/BeamFnDataOutboundAggregatorTest.java | 135 +++++-----
.../beam/sdk/transforms/AsyncWrapperTest.java | 43 ++--
.../opentelemetry-gcp-auth-extension/build.gradle | 1 +
.../opentelemetry/gcp/auth/ConfigurableOption.java | 1 +
...GcpAuthAutoConfigurationCustomizerProvider.java | 196 ++++++++-------
...nfigure.spi.AutoConfigurationCustomizerProvider | 16 --
...uthAutoConfigurationCustomizerProviderTest.java | 276 +++++++++++++--------
.../meta/provider/iceberg/IcebergMetastore.java | 8 +-
.../provider/iceberg/IcebergMetastoreTest.java | 13 +
.../impl/transform/BeamBuiltinAggregations.java | 2 +
.../sql/impl/transform/agg/VarianceFn.java | 38 ++-
.../sql/BeamSqlDslAggregationVarianceTest.java | 43 +++-
.../sql/impl/transform/agg/VarianceFnTest.java | 25 +-
.../java/org/apache/beam/fn/harness/FnHarness.java | 49 ++--
.../fn/harness/control/ProcessBundleHandler.java | 50 ++--
.../beam/fn/harness/data/BeamFnDataClient.java | 28 +--
.../beam/fn/harness/data/BeamFnDataGrpcClient.java | 91 ++++---
.../beam/fn/harness/BeamFnDataWriteRunnerTest.java | 44 ++--
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 2 +-
.../PTransformRunnerFactoryTestContext.java | 12 +-
.../harness/control/ProcessBundleHandlerTest.java | 47 ++--
.../fn/harness/data/BeamFnDataGrpcClientTest.java | 41 ++-
.../beam/sdk/io/clickhouse/ClickHouseIO.java | 3 +
.../beam/sdk/io/clickhouse/ClickHouseWriter.java | 40 +++
.../apache/beam/sdk/io/clickhouse/TableSchema.java | 53 +++-
.../clickhouse/src/main/javacc/ColumnTypeParser.jj | 27 ++
.../beam/sdk/io/clickhouse/ClickHouseIOIT.java | 119 +++++++++
.../sdk/io/clickhouse/ClickHouseWriterTest.java | 141 +++++++++++
.../beam/sdk/io/clickhouse/TableSchemaTest.java | 102 ++++++++
.../beam/sdk/io/gcp/pubsub/ExternalWrite.java | 6 +
.../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java | 5 +-
.../beam/sdk/io/gcp/spanner/SpannerAccessor.java | 13 +-
.../beam/sdk/io/gcp/spanner/SpannerConfig.java | 37 +++
.../apache/beam/sdk/io/gcp/spanner/SpannerIO.java | 171 ++++++++++++-
.../io/gcp/spanner/SpannerTransformRegistrar.java | 30 +++
.../MetadataSpannerConfigFactory.java | 6 +
.../beam/sdk/io/gcp/spanner/SpannerReadIT.java | 33 ++-
.../beam/sdk/io/gcp/spanner/SpannerTestHelper.java | 110 ++++++++
.../beam/sdk/io/gcp/spanner/SpannerWriteIT.java | 110 ++++----
.../changestreams/it/IntegrationTestEnv.java | 17 +-
.../changestreams/it/SpannerChangeStreamIT.java | 19 +-
...StreamOrderedByTimestampAndTransactionIdIT.java | 10 +-
...nnerChangeStreamOrderedWithinKeyGloballyIT.java | 10 +-
.../it/SpannerChangeStreamOrderedWithinKeyIT.java | 10 +-
.../it/SpannerChangeStreamPlacementTableIT.java | 19 +-
...pannerChangeStreamPlacementTablePostgresIT.java | 10 +-
.../it/SpannerChangeStreamPostgresIT.java | 10 +-
...SpannerChangeStreamTransactionBoundariesIT.java | 10 +-
.../it/SpannerChangeStreamsSchemaTransformIT.java | 4 +
.../org/apache/beam/sdk/io/iceberg/AddFiles.java | 39 +--
.../beam/sdk/io/iceberg/IcebergCatalogConfig.java | 2 +-
.../org/apache/beam/io/requestresponse/Call.java | 1 +
.../apache/beam/io/requestresponse/CallTest.java | 53 ++--
sdks/java/testing/nexmark/build.gradle | 15 ++
sdks/java/testing/tpcds/build.gradle | 15 ++
.../controller-container/Dockerfile | 2 +-
sdks/python/apache_beam/dataframe/frames.py | 7 +-
sdks/python/apache_beam/dataframe/frames_test.py | 4 +-
sdks/python/apache_beam/io/external/gcp/pubsub.py | 11 +-
sdks/python/apache_beam/io/gcp/gcsio.py | 50 +++-
sdks/python/apache_beam/io/gcp/gcsio_test.py | 92 +++++++
sdks/python/apache_beam/io/gcp/pubsub.py | 48 +++-
.../apache_beam/io/gcp/pubsub_integration_test.py | 90 +++++++
sdks/python/apache_beam/io/gcp/pubsub_test.py | 72 ++++++
sdks/python/apache_beam/ml/inference/base.py | 6 +
.../ml/rag/enrichment/milvus_search_it_test.py | 1 +
.../ml/rag/ingestion/milvus_search_it_test.py | 1 +
sdks/python/apache_beam/ml/rag/test_utils.py | 1 +
.../python/apache_beam/options/pipeline_options.py | 2 +-
.../apache_beam/runners/dataflow/internal/names.py | 2 +-
sdks/python/apache_beam/yaml/examples/README.md | 4 +
sdks/python/apache_beam/yaml/main.py | 7 +-
sdks/python/apache_beam/yaml/yaml_io.py | 21 +-
sdks/python/apache_beam/yaml/yaml_io_test.py | 103 ++++++++
sdks/python/apache_beam/yaml/yaml_provider.py | 11 +-
sdks/python/apache_beam/yaml/yaml_transform.py | 56 ++++-
.../python/apache_beam/yaml/yaml_transform_test.py | 119 +++++++++
.../container/ml/py310/base_image_requirements.txt | 57 ++---
.../container/ml/py310/gpu_image_requirements.txt | 75 +++---
.../container/ml/py311/base_image_requirements.txt | 57 ++---
.../container/ml/py311/gpu_image_requirements.txt | 75 +++---
.../container/ml/py312/base_image_requirements.txt | 59 ++---
.../container/ml/py312/gpu_image_requirements.txt | 77 +++---
.../container/ml/py313/base_image_requirements.txt | 59 ++---
.../container/py310/base_image_requirements.txt | 51 ++--
.../container/py311/base_image_requirements.txt | 53 ++--
.../container/py312/base_image_requirements.txt | 55 ++--
.../container/py313/base_image_requirements.txt | 55 ++--
.../container/py314/base_image_requirements.txt | 55 ++--
sdks/python/scripts/run_integration_test.sh | 11 +-
sdks/python/setup.py | 9 +-
sdks/python/test-suites/dataflow/common.gradle | 2 +
sdks/typescript/package-lock.json | 43 ++--
sdks/typescript/package.json | 2 +-
sdks/typescript/src/apache_beam/runners/flink.ts | 2 +-
website/www/site/assets/js/bootstrap.js | 46 +++-
website/www/site/assets/js/bootstrap/alert.js | 7 +-
website/www/site/assets/js/bootstrap/carousel.js | 9 +-
website/www/site/assets/js/bootstrap/collapse.js | 6 +-
website/www/site/assets/js/bootstrap/dropdown.js | 7 +-
website/www/site/assets/js/bootstrap/modal.js | 8 +-
website/www/site/assets/js/bootstrap/tooltip.js | 9 +-
website/www/site/assets/js/page-nav.js | 2 +-
.../site/content/en/documentation/dsls/sql/ddl.md | 2 +-
.../site/content/en/documentation/runners/flink.md | 10 +
.../www/site/content/en/documentation/sdks/yaml.md | 34 +++
499 files changed, 4249 insertions(+), 1882 deletions(-)
copy .github/trigger_files/{beam_PostCommit_Java_Nexmark_Flink.json =>
beam_PostCommit_Java_Tpcds_Flink.json} (100%)
delete mode 100644 runners/flink/1.17/build.gradle
delete mode 100644 runners/flink/1.18/build.gradle
delete mode 100644
runners/flink/1.19/src/test/java/org/apache/beam/runners/flink/streaming/MemoryStateBackendWrapper.java
delete mode 100644
runners/flink/1.19/src/test/java/org/apache/beam/runners/flink/streaming/StreamSources.java
copy runners/flink/{2.0 => 2.1}/build.gradle (86%)
rename runners/flink/{1.17 => 2.1}/job-server-container/build.gradle (100%)
rename runners/flink/{1.17 => 2.1}/job-server/build.gradle (80%)
copy runners/flink/{2.0 => 2.2}/build.gradle (57%)
rename runners/flink/{1.18 => 2.2}/job-server-container/build.gradle (100%)
rename runners/flink/{1.18 => 2.2}/job-server/build.gradle (80%)
copy runners/flink/{2.0 =>
2.2}/src/main/java/org/apache/beam/runners/flink/FlinkExecutionEnvironments.java
(99%)
copy runners/flink/{2.0 =>
2.2}/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/DoFnOperator.java
(99%)
copy runners/flink/{2.0 =>
2.2}/src/test/java/org/apache/beam/runners/flink/FlinkPipelineOptionsTest.java
(92%)
delete mode 100644
sdks/java/extensions/opentelemetry-gcp-auth-extension/src/main/resources/META-INF/services/io.opentelemetry.sdk.autoconfigure.spi.AutoConfigurationCustomizerProvider
create mode 100644
sdks/java/io/clickhouse/src/test/java/org/apache/beam/sdk/io/clickhouse/ClickHouseWriterTest.java
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/spanner/SpannerTestHelper.java
