This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/pip/sdks/python/distlib-0.4.3
in repository https://gitbox.apache.org/repos/asf/beam.git
omit a912a00afdc Bump distlib from 0.4.2 to 0.4.3 in /sdks/python
add 6ed0635429a Spanner: Extend SpannerIO to support Spanner Omni mTLS
setup (#38928)
add 378e10de4ea ClickHouseIO: Add DateTime64 support for sub-second
timestamp precision (#38510)
add 98e29d99fcd Revert "Upgrade expansion jar to java17 (#38931)" (#38965)
add bde545f91e4 Add support for STDDEV_POP and STDDEV_SAMP in VarianceFn
(#38871)
add 77348121ee9 Update BEAM_DEV_SDK_CONTAINER_TAG version (#38963)
add a996a9fb610 Bump protobufjs from 8.4.0 to 8.6.0 in /sdks/typescript
(#38968)
add 2c4822959e1 Bump form-data from 2.5.5 to 2.5.6 in /sdks/typescript
(#38967)
add b7bc937f592 Use Flink 2.0 for load tests (#38279)
add c0cc8897f4a Bump cloud.google.com/go/spanner from 1.91.0 to 1.92.0 in
/sdks (#38976)
add 468ae40dc8e Fix AsyncWrapperTest timeout and flakiness issues. (#38970)
add e55a1f7399b fix failure in opentelemetry-gcp-auth-extension jar
(#38938)
add 33b34574b3c Bump jsonpickle upper bound. (#38769)
add 2c53494f735 [Dataflow Java] Clarify which portions of
DataflowWorkerLoggingOptions are deprecated (#38960)
add 0bc785253eb Fix WriteToPubSub to pass ordering_key to publish() method
(#37345)
add d032f0e3ef4 Add drain support for Dataflow and Flink (#38786)
add c608b4da8de Bump google.golang.org/api from 0.284.0 to 0.285.0 in
/sdks (#38997)
add 9765e29de68 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#38998)
add 6ccd0c9c861 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#38999)
add b9342767cc5 fix sentence (#38989)
add 597f92530f1 address DOM text reinterpreted as HTML alert (#38949)
add 56d4ffdab31 Align gcpauth extension implementation with ability to
turn it off easily while still being added as dependency.
add 2802de39b2e Merge pull request #38846: [OpenTelemetry] Add turning off
to gcpauth extension
add ee92a553e5d Disable public IP for Dataflow Python and Go Validate
runner tests (#38990)
add 1c182507444 Add support for Apache Flink 2.1.3 (#38961)
add 1d703fe904f Make ModelManager import more robust (#38936)
add 849fcf89c81 [Beam SQL Shell] Add Iceberg deps when using icebergio
(#38994)
add a3f9e0e7d96 Add publish_time_field to ReadFromPubSub YAML transform
(#38985)
add 15d00559d75 Bump cloud.google.com/go/bigtable from 1.49.0 to 1.50.0 in
/sdks (#39012)
add 5c34e1c1c85 Exclude tests for batch-dataset (#39014)
add 9e465a7cfd7 fix parsing error for typescript (#38898)
add c81059fb246 Drop Flink 1.17,1.18 support (#39006)
add 466989d50a4 cancel user code with interruption after timeout (#39018)
add 09c962c4aef Fix Milvus ML PreCommit xdist, container startup (#39007)
add b4e023afece Bump nodemailer from 8.0.5 to 9.0.1 in
/scripts/ci/issue-report (#39019)
add 17bed431e05 remove shardedKey (#39024)
add 63bcd3dd2b5 Validate Project of staging bucket (#39008)
add 8ba04741b47 Sanitize logging in FanOutStreamingEngineWorkerHarness
(#39029)
add 974ad17b60d Increase CallTest sleep durations to keep test from being
flaky due to timeout not being observed. (#39016)
add caba399f96e [Dataflow Java] Fix incorrect warning log when specifying
logger override. (#39034)
add 1df57236fe3 Bump github.com/moby/moby/api from 1.54.2 to 1.55.0 in
/sdks (#39031)
add fc370c9fdc8 [FnApi Java] Add support for separate named data streams
to provide bundle isolation (#38863)
add 630a34c3bfa Bump github.com/moby/moby/client from 0.4.1 to 0.5.0 in
/sdks (#39032)
add a21ca397b42 [Iceberg AddFiles] Add NameMapping when creating table
(#39022)
add 5334dc1d92a Add Flink 2.2.1 runner support (#38980)
add 06aa37bdffd use proper table naming in iceberg sql (#39035)
add e948ef62041 Roll forward io expansion service to Java17 (#38974)
add eaba570c569 Bump github.com/golang-cz/devslog from 0.0.16 to 0.0.17 in
/sdks (#39054)
add 54231e89266 try to fix forward tests for java 17 (#39058)
add 9aed894f5d4 Update pandas version upper bound to support python 3.14
(#39056)
add 9868954ce8c Fix playground precommit test failure (#39062)
add c2474960db7 [yaml] - expand jinja method (#38547)
add d031bddfdc9 Bump actions/checkout from 6 to 7 (#39033)
add 117bb893ca8 Bump google.golang.org/api from 0.285.0 to 0.286.0 in
/sdks (#39068)
add 9a9f48b9542 Fix Flink 2.1+ dependency resolution (#39061)
add c77b2d40626 Update Python Dependencies (#39070)
add a467fdc437f Enable precommit yaml xlang test on code push. (#39071)
add f61d0b5eeff Release Note: Rename Dataflow Runner to Dataflow Portable
Runner (#38747)
add f29d9af139a init (#39025)
add 447899e46e9 [mqtt] Add Python Xlang Messaging PostCommit with MQTT
integration tests (#38966)
add cedfd0bb3e8 [ReduceFnRunner] Fix Prefetches (#39082)
add c3d9a731b42 [Dataflow Streaming] Increase stuck commit invalidation
timeout to 1 hour (#39083)
add 24e9ed4e0e9 Bump actions/cache from 4 to 6 (#39081)
add f7f0e1655d5 Bump actions/checkout from 6 to 7 (#39080)
add 0165344ab13 Add UnboundedCountingSource::to for bounded reads from an
UnboundedCountingSource (#39084)
add f33feafb2b2 [Dataflow Java Streaming] Add a timeout to how long
commits will retry to the service. (#39085)
add 857dfc9a875 [mqtt] Fix streaming xlang IT failing the Messaging
PostCommit (#39088)
add 0802263e48e Add a github workflow to publish vllm image. (#39089)
add 8e4ea736213 [Python] Optimize BigQuery copy jobs in file loads using
multi-source copy (#38983)
add 5afb93c8c09 [OpenTelemetry] Turn off gcp otel auth extension by
default. (#38940)
add 4e9e483a51a Fix Flink XVR for Flink 2
add 49fd8745223 Fix Go Flink VR conf path
add 16acfa8a2c6 Update CHANGES.md and website
add f13ccf7afbe Merge pull request #39077 from Abacn/fix-flink-xvr
add 9e28c9d2150 Disable flaky SDF finalization tests
add 6095fd0de62 Merge pull request #39092 from
arunpandianp/disablesdffinalization
add 70b72adffee Fix Install xmllint
add 0aa808dba09 Merge pull request #39094 from apache/cut-release-branch
add cad9f1ebe76 Moving to 2.76.0-SNAPSHOT on master branch.
add beeb715739f Update beam-master (#39095)
add c531095fc40 [GSOC 2026] Adding logic to validate and generate an error
if there are key… (#38992)
add 8d252c4659b update changes log for yaml improvements etc (#39093)
add 3fba9950feb Update beam-master container
add e56ed7718a5 Trigger failed postcommit tests.
add 7454aa6a0bf Merge pull request #39100 from
shunping/update-python-beam-master
add d71c4aca4f4 Fix race condition in DirectRunner executor shutdown
add 0af28db1142 Apply suggested fix
add 23521069470 Merge pull request #39096 from shunping/fix-flaky-rrio-test
add 96733599e6c Fix JsonToRow swallowing downstream errors when runners
fuse transforms. (#39098)
add 8092349ca28 Enable playground tests triggered on cron schedule (#39069)
add 8ecdab8da94 [Iceberg CDC] Import BaseIncrementalChangelogScan (#38823)
add 8c311e45672 [Iceberg CDC] Add utils base, delete reader, and
serializable files (#38821)
add c1898ff68b8 Fix pip ResolutionTooDeep (#39017)
add 9d3694165e1 [Python] Add UnboundedSource SDF wrapper (#19137) (#38724)
add 5eefc931b5d remove infra change (#39104)
add eef26ca8b71 Revert "[Python] Optimize BigQuery copy jobs in file loads
using multi-source copy" (#39106)
add 0c51b0d288b Write append tables can be asynchronous (#39120)
add b642c5cbd0e Fix typo (#39123)
add 56b5a52294d Bump google-cloud-aiplatform (#39113)
add d77d12a47b2 Update cython requirement from <4,>=3.2.5 to >=3.2.6,<4 in
/sdks/python (#39099)
add 5cb2f09298c [Website] Update Python version compatibility table
(#38969)
add 698420027d5 Docs: update Python version support in Python quickstart
(#39122)
add 8ccd1d70c04 including GitHub Actions to schedule daily audits and Add
documentati… (#39116)
add 5a2e98bb712 Fix a flaky test in ApproximateQuantilesTest (#39132)
add e3b4d8c5d0e Fix flaky ML RunInference tests by disabling reshuffle on
beam.Create (#39118)
add 3cca8fa3dac [Dataflow Streaming] Access state/timerinternals via
StepContext (#38991)
add 2e8f75aaf4b Bump actions/checkout from 6 to 7 (#39147)
add b63ea65d6a3 Bump github.com/aws/smithy-go from 1.27.2 to 1.27.3 in
/sdks (#39145)
add 31cd92f5f55 Bump cloud.google.com/go/storage from 1.62.3 to 1.63.0 in
/sdks (#39144)
add edd3bfca48e Fix flaky GcsIOIntegrationTest and handle GCS bucket
creation race conditions (#39130)
add af005ef679c fix post commit yaml test (#39142)
add 31175f9ab82 fix race condition in statesampler with lock for reset
(#39129)
add ccac91ad9b8 add zizmor to existing precommit GHA workflow (#39108)
add f17b370e74a Fix flaky PubSub integration test by deduplicating
messages (#39134)
add 402b41c726d Fix ThreadSanitizer data race and failed RPC calls (#39076)
add 961ed7c31ad [IcebergIO] Fix stale openWriters count in
RecordWriterManager (#39157)
add f909e8a7af9 Use Flink 2.2 container for load tests
add 984df275bf4 debug only change -- preserve cluster to check error
add 397d9c61a27 Set configs for Flink 2
add a0fd9502818 Refactor Flink Load Tests to use native Dataproc
components and Auto Zone
add 3e76ff518fa Remove unnecessary gcloud volume mount from Job Server
add 5d28c414f62 Change memory allocation, use resize feature
add 30a5a00d584 Merge pull request #39154 from apache/flink-load-test-ver
add f9171da59bc Bump github.com/nats-io/nats-server/v2 from 2.14.2 to
2.14.3 in /sdks (#39168)
add aa6942a9853 Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#39169)
add fcd105de015 Bump js-yaml from 3.14.2 to 3.15.0 in /website/www (#39172)
add 24a2ccc830a Bump com.gradle.common-custom-user-data-gradle-plugin
(#39166)
add 1c4b2047016 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#39170)
add aec5b5da813 Add embedded NVIDIA Dynamo support to vLLM ModelHandler
(#38701)
add 8f60e69177b Fixed DirectRunner PubSub subscriber client lifecycle
(#39079)
add ed0a5832eb1 Add open telemetry dependency to dataflow worker (#38941)
add a86e6115270 Retry starting SubprocessServer on failure (#39159)
add e34cc96df4d [yaml] - mongodb read normalization (#38772)
add 78fdc959cda [Dataflow Streaming] [Multi Key] Prepare
StreamingModeExecutionContext and StreamingWorkScheduler for multi-key
execution. (#38814)
add aec0392a343 Revert previous workarounds and upgrade TFX stack to
1.21.0 (#39164)
add 74059db52cd Bump google.golang.org/grpc from 1.81.1 to 1.82.0 in /sdks
(#39186)
add f08c259a02e Bump google.golang.org/api from 0.286.0 to 0.287.0 in
/sdks (#39185)
add e87f50e3a9a Fix Python VarIntCoder OverflowError on uint64 values
(#39047)
add d0d754c635d Acknowledge messages asap in pubsub test (#39183)
add 8c0f0e02a82 Update Python Dependencies (#39139)
add 2f7d95d1cf9 [Gemini] Add batching support to Java Remote Inference
(#39067)
add 5f3fc19127e [Gemini] Add retry filter support to the Java Remote
RetryHandler (#39004)
add dac2848f4ae Upgrade TFX stack to 1.21.x and remove numpy/pandas bounds
add c2a62c12f94 Append timestamp to artifact_location and output_vocab
add 11cb59ed70c Upgrade tfx stack. Remove some upper bounds.
add 781ec5cdecf Consolidate the test requirements file to examples.
add 1567148726c Run one-hot test only
add b597f364dbd Remove ml_extra in one-hot load test
add 54783520416 Revert "Run one-hot test only"
add 1876512bb88 Minor edit on requirements.txt
add bc9937ade50 Fix typo
add 4a976d393c9 Merge pull request #39163 from apache/resolution-too-deep
add 00823b29fa4 Migrate MqttIO to HiveMQ Mqtt client (#39180)
add 8610459f7b8 [Gemini] Port client-side throttling to the Java SDK
(#39021)
add ca66eda1bc1 delta lake python/yaml (#39052)
add eed2511dcce Add "-Pjava21Home" to stage docker step (#39181)
add 7b3e2df2ed6 Bump transformers (#39195)
add c38839082de Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks
(#39199)
add 22613182291 Bump docker/build-push-action from 7.2.0 to 7.3.0 (#39198)
add db9f9d56022 Bump docker/setup-qemu-action from 4.1.0 to 4.2.0 (#39197)
add 70329063989 Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#39200)
add a2a14f511e9 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#39201)
add 95e783d0eef Install wget
add fff406dd6c1 Merge pull request #39189 from apache/validate-275-rc1
add 956fe0c90e4 [Flink] Bound SDF self-checkpoint residual state on the
portable runner (#39191)
add b9a506743a1 Bump cryptography from 47.0.0 to 48.0.1 in Python
container images (#39204)
add 371a33a54b4 Bump docker/login-action from 4.2.0 to 4.3.0 (#39208)
add 8d1728e8455 Bump docker/setup-buildx-action from 4.1.0 to 4.2.0
(#39209)
add a3d32977f46 Bump github.com/testcontainers/testcontainers-go from
0.42.0 to 0.43.0 in /sdks (#39053)
add 0ec08474e61 Bump docker/login-action from 4.3.0 to 4.4.0 (#39217)
add 2940f8fc6a0 Added Criteo TFT fill_in_missing helper (#39011)
add 0b407cd78ce Fix lost state updates in Set state (#39175)
add 09d63ccbb36 Bump pyo3 from 0.27.2 to 0.29.0 in
/sdks/python/apache_beam/examples/wordcount_rust/word_processing (#38953)
add 4d975e5ec60 Avoid RequestResponseIO throttler access when throttler is
absent (#39112)
add 904f8898ab2 Fix PostCommit Java DataflowV2 workflow (#39232)
add 4bf5a6afb50 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#39227)
add 4cde7ed933a Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#39229)
add 7502ae2d529 Bump golang.org/x/text from 0.38.0 to 0.39.0 in /sdks
(#39230)
add f35fa826f44 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#39231)
add bdc26675c91 Drop envoy-data-plane/betterproto dependency from Python
SDK (#39213)
add c6e13b60fa4 Revert "Fix Python VarIntCoder OverflowError on uint64
values (#39047)" (#39218)
add 20494736bb9 Add MLTransform embedding benchmarks (#38917)
add d1c1a681d83 [aws2] Make SqsIOWriteBatchesTest timeout tests
timing-independent (#38971)
add 4a82e692e78 remove todos etc with pubsublite deprecation (#39237)
add 123dc7feaa4 Bump CI Java version to Java21 (#39205)
add fdd6b7b94c4 Adding release-2.75.0-postrelease to protected branches in
.asf.yaml
add 93d3aae1a4b Update managed-io.md for release 2.75.0-RC1.
add c6193b06ced Merge pull request #39178 from
apache/updates_managed_io_docs_2.75.0_rc1
add 954de0d7846 Update Beam website to release 2.75.0
add 5b7064e44a9 Update release date
add 5fd72c328d4 Update CHANGES.md
add 477c7477d62 Merge pull request #39190 from apache/website-2-75
add 2cecde92a13 Bump google.golang.org/api from 0.287.0 to 0.287.1 in
/sdks (#39239)
add bbb1c7592c7 Bump cloud.google.com/go/pubsub from 1.50.2 to 1.50.3 in
/sdks (#39240)
add 27d699eb721 [Gemini] Add client-side throttling to Java Remote
Inference (#39194)
add 227bcded5aa add upgrade gcp bom workflow (#38711)
add 401844f7131 add mongodbio and datadogio to io connectors for yaml
(#39223)
add 78e2a33d2a8 Bump distlib from 0.4.2 to 0.4.3 in /sdks/python
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a912a00afdc)
\
N -- N -- N refs/heads/dependabot/pip/sdks/python/distlib-0.4.3
(78e2a33d2a8)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 2 +
.../test-properties.json | 2 +-
.../actions/setup-environment-action/action.yml | 4 +-
.../arc/images/Dockerfile | 18 +-
.github/trigger_files/beam_PostCommit_Go.json | 2 +-
.../trigger_files/beam_PostCommit_Go_VR_Flink.json | 2 +-
.../beam_PostCommit_Java_DataflowV2.json | 2 +-
.../beam_PostCommit_Java_Nexmark_Flink.json | 2 +-
....json => beam_PostCommit_Java_Tpcds_Flink.json} | 0
...it_Java_ValidatesRunner_Dataflow_Streaming.json | 2 +-
..._ValidatesRunner_Dataflow_Streaming_Engine.json | 2 +-
...ostCommit_Java_ValidatesRunner_Dataflow_V2.json | 2 +-
...beam_PostCommit_Java_ValidatesRunner_Spark.json | 18 +-
.github/trigger_files/beam_PostCommit_Python.json | 4 +-
.../beam_PostCommit_Python_Examples_Dataflow.json | 4 +-
...PostCommit_Python_ValidatesRunner_Dataflow.json | 2 +-
..._PostCommit_Python_Xlang_Messaging_Direct.json} | 0
.../trigger_files/beam_PostCommit_XVR_Flink.json | 2 +-
.../trigger_files/beam_PostCommit_XVR_Samza.json | 1 -
.../beam_PostCommit_Yaml_Xlang_Direct.json | 2 +-
.../trigger_files/beam_PreCommit_Python_ML.json | 2 +-
.github/workflows/IO_Iceberg_Integration_Tests.yml | 2 +-
.../IO_Iceberg_Integration_Tests_Dataflow.yml | 2 +-
..._Iceberg_Managed_Integration_Tests_Dataflow.yml | 2 +-
.github/workflows/IO_Iceberg_Performance_Tests.yml | 2 +-
.github/workflows/IO_Iceberg_Unit_Tests.yml | 2 +-
.github/workflows/README.md | 6 +-
.github/workflows/assign_milestone.yml | 2 +-
.github/workflows/beam_CancelStaleDataflowJobs.yml | 2 +-
.../workflows/beam_CleanUpDataprocResources.yml | 2 +-
.github/workflows/beam_CleanUpGCPResources.yml | 2 +-
.../workflows/beam_CleanUpPrebuiltSDKImages.yml | 2 +-
.../workflows/beam_CloudML_Benchmarks_Dataflow.yml | 2 +-
.../beam_IODatastoresCredentialsRotation.yml | 2 +-
.../beam_Inference_Python_Benchmarks_Dataflow.yml | 45 +-
.../beam_Infrastructure_AuditUnmanagedKeys.yml | 69 +
.../beam_Infrastructure_PolicyEnforcer.yml | 2 +-
.../beam_Infrastructure_SecurityLogging.yml | 2 +-
.../beam_Infrastructure_ServiceAccountKeys.yml | 2 +-
.../beam_Infrastructure_UsersPermissions.yml | 2 +-
.github/workflows/beam_Java_JMH.yml | 2 +-
.../beam_Java_LoadTests_Combine_Smoke.yml | 2 +-
.../beam_LoadTests_Go_CoGBK_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_CoGBK_Flink_batch.yml | 10 +-
.../beam_LoadTests_Go_Combine_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_Combine_Flink_Batch.yml | 16 +-
.../beam_LoadTests_Go_GBK_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_GBK_Flink_Batch.yml | 16 +-
.../beam_LoadTests_Go_ParDo_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_ParDo_Flink_Batch.yml | 8 +-
.../beam_LoadTests_Go_SideInput_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_SideInput_Flink_Batch.yml | 10 +-
.../beam_LoadTests_Java_CoGBK_Dataflow_Batch.yml | 2 +-
...eam_LoadTests_Java_CoGBK_Dataflow_Streaming.yml | 2 +-
...s_Java_CoGBK_Dataflow_V2_Batch_JavaVersions.yml | 2 +-
...va_CoGBK_Dataflow_V2_Streaming_JavaVersions.yml | 2 +-
...s_Java_CoGBK_SparkStructuredStreaming_Batch.yml | 2 +-
.../beam_LoadTests_Java_Combine_Dataflow_Batch.yml | 2 +-
...m_LoadTests_Java_Combine_Dataflow_Streaming.yml | 2 +-
...Java_Combine_SparkStructuredStreaming_Batch.yml | 2 +-
.../beam_LoadTests_Java_GBK_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Java_GBK_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Java_GBK_Dataflow_V2_Batch.yml | 2 +-
...LoadTests_Java_GBK_Dataflow_V2_Batch_Java17.yml | 2 +-
...am_LoadTests_Java_GBK_Dataflow_V2_Streaming.yml | 2 +-
...Tests_Java_GBK_Dataflow_V2_Streaming_Java17.yml | 2 +-
.../workflows/beam_LoadTests_Java_GBK_Smoke.yml | 2 +-
...sts_Java_GBK_SparkStructuredStreaming_Batch.yml | 2 +-
.../beam_LoadTests_Java_ParDo_Dataflow_Batch.yml | 2 +-
...eam_LoadTests_Java_ParDo_Dataflow_Streaming.yml | 2 +-
...s_Java_ParDo_Dataflow_V2_Batch_JavaVersions.yml | 2 +-
...va_ParDo_Dataflow_V2_Streaming_JavaVersions.yml | 2 +-
...s_Java_ParDo_SparkStructuredStreaming_Batch.yml | 2 +-
.github/workflows/beam_LoadTests_Java_PubsubIO.yml | 2 +-
.../beam_LoadTests_Python_CoGBK_Dataflow_Batch.yml | 2 +-
...m_LoadTests_Python_CoGBK_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_CoGBK_Flink_Batch.yml | 8 +-
...eam_LoadTests_Python_Combine_Dataflow_Batch.yml | 2 +-
...LoadTests_Python_Combine_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_Combine_Flink_Batch.yml | 18 +-
...am_LoadTests_Python_Combine_Flink_Streaming.yml | 8 +-
...LoadTests_Python_FnApiRunner_Microbenchmark.yml | 2 +-
.../beam_LoadTests_Python_GBK_Dataflow_Batch.yml | 2 +-
...eam_LoadTests_Python_GBK_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_GBK_Flink_Batch.yml | 18 +-
...adTests_Python_GBK_reiterate_Dataflow_Batch.yml | 2 +-
...sts_Python_GBK_reiterate_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_ParDo_Dataflow_Batch.yml | 2 +-
...m_LoadTests_Python_ParDo_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_ParDo_Flink_Batch.yml | 10 +-
...beam_LoadTests_Python_ParDo_Flink_Streaming.yml | 10 +-
...m_LoadTests_Python_SideInput_Dataflow_Batch.yml | 2 +-
.github/workflows/beam_LoadTests_Python_Smoke.yml | 2 +-
.../workflows/beam_MetricsCredentialsRotation.yml | 2 +-
.github/workflows/beam_Metrics_Report.yml | 2 +-
.../workflows/beam_PerformanceTests_AvroIOIT.yml | 2 +-
.../beam_PerformanceTests_AvroIOIT_HDFS.yml | 2 +-
...PerformanceTests_BigQueryIO_Batch_Java_Avro.yml | 2 +-
...PerformanceTests_BigQueryIO_Batch_Java_Json.yml | 2 +-
..._PerformanceTests_BigQueryIO_Streaming_Java.yml | 2 +-
...eam_PerformanceTests_BiqQueryIO_Read_Python.yml | 2 +-
...formanceTests_BiqQueryIO_Write_Python_Batch.yml | 2 +-
.github/workflows/beam_PerformanceTests_Cdap.yml | 2 +-
.../beam_PerformanceTests_Compressed_TextIOIT.yml | 2 +-
...m_PerformanceTests_Compressed_TextIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_HadoopFormat.yml | 2 +-
.github/workflows/beam_PerformanceTests_JDBC.yml | 2 +-
.../workflows/beam_PerformanceTests_Kafka_IO.yml | 2 +-
.../beam_PerformanceTests_ManyFiles_TextIOIT.yml | 2 +-
...am_PerformanceTests_ManyFiles_TextIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_MongoDBIO_IT.yml | 2 +-
.../beam_PerformanceTests_ParquetIOIT.yml | 2 +-
.../beam_PerformanceTests_ParquetIOIT_HDFS.yml | 2 +-
...erformanceTests_PubsubIOIT_Python_Streaming.yml | 2 +-
...m_PerformanceTests_SQLBigQueryIO_Batch_Java.yml | 2 +-
.../beam_PerformanceTests_SingleStoreIO.yml | 2 +-
..._PerformanceTests_SpannerIO_Read_2GB_Python.yml | 2 +-
...manceTests_SpannerIO_Write_2GB_Python_Batch.yml | 2 +-
.../beam_PerformanceTests_SparkReceiver_IO.yml | 2 +-
.../beam_PerformanceTests_TFRecordIOIT.yml | 2 +-
.../beam_PerformanceTests_TFRecordIOIT_HDFS.yml | 2 +-
.../workflows/beam_PerformanceTests_TextIOIT.yml | 2 +-
.../beam_PerformanceTests_TextIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_TextIOIT_Python.yml | 2 +-
...PerformanceTests_WordCountIT_PythonVersions.yml | 2 +-
.../workflows/beam_PerformanceTests_XmlIOIT.yml | 2 +-
.../beam_PerformanceTests_XmlIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_xlang_KafkaIO_Python.yml | 3 +-
.github/workflows/beam_Playground_CI_Nightly.yml | 2 +-
.github/workflows/beam_Playground_Precommit.yml | 5 +-
.github/workflows/beam_PostCommit_Go.yml | 4 +-
.../workflows/beam_PostCommit_Go_Dataflow_ARM.yml | 4 +-
.github/workflows/beam_PostCommit_Go_VR_Flink.yml | 2 +-
.github/workflows/beam_PostCommit_Go_VR_Spark.yml | 2 +-
.github/workflows/beam_PostCommit_Java.yml | 2 +-
.../beam_PostCommit_Java_Avro_Versions.yml | 2 +-
.../beam_PostCommit_Java_BigQueryEarlyRollout.yml | 2 +-
.../workflows/beam_PostCommit_Java_DataflowV1.yml | 2 +-
.../workflows/beam_PostCommit_Java_DataflowV2.yml | 6 +-
.../beam_PostCommit_Java_Examples_Dataflow.yml | 2 +-
.../beam_PostCommit_Java_Examples_Dataflow_ARM.yml | 4 +-
...beam_PostCommit_Java_Examples_Dataflow_Java.yml | 2 +-
.../beam_PostCommit_Java_Examples_Dataflow_V2.yml | 2 +-
...m_PostCommit_Java_Examples_Dataflow_V2_Java.yml | 2 +-
.../beam_PostCommit_Java_Examples_Direct.yml | 2 +-
.../beam_PostCommit_Java_Examples_Flink.yml | 4 +-
.../beam_PostCommit_Java_Examples_Spark.yml | 2 +-
.../beam_PostCommit_Java_Hadoop_Versions.yml | 2 +-
.../beam_PostCommit_Java_IO_Performance_Tests.yml | 4 +-
.../beam_PostCommit_Java_InfluxDbIO_IT.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Dataflow.yml | 4 +-
...beam_PostCommit_Java_Jpms_Dataflow_Versions.yml | 2 +-
.../workflows/beam_PostCommit_Java_Jpms_Direct.yml | 4 +-
.../beam_PostCommit_Java_Jpms_Direct_Versions.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Flink_Java11.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Spark_Java11.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Dataflow.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Dataflow_V2.yml | 2 +-
...am_PostCommit_Java_Nexmark_Dataflow_V2_Java.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Direct.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Flink.yml | 7 +-
.../beam_PostCommit_Java_Nexmark_Spark.yml | 2 +-
.../beam_PostCommit_Java_PVR_Flink_Batch.yml | 4 +-
.../beam_PostCommit_Java_PVR_Flink_Streaming.yml | 6 +-
.../beam_PostCommit_Java_PVR_Spark3_Streaming.yml | 2 +-
.../beam_PostCommit_Java_PVR_Spark4_Batch.yml | 2 +-
.../beam_PostCommit_Java_PVR_Spark4_Streaming.yml | 2 +-
.../beam_PostCommit_Java_PVR_Spark_Batch.yml | 2 +-
.../beam_PostCommit_Java_SingleStoreIO_IT.yml | 2 +-
.../beam_PostCommit_Java_Tpcds_Dataflow.yml | 2 +-
.../workflows/beam_PostCommit_Java_Tpcds_Flink.yml | 4 +-
.../workflows/beam_PostCommit_Java_Tpcds_Spark.yml | 2 +-
...am_PostCommit_Java_ValidatesRunner_Dataflow.yml | 2 +-
..._Java_ValidatesRunner_Dataflow_JavaVersions.yml | 2 +-
...mit_Java_ValidatesRunner_Dataflow_Streaming.yml | 2 +-
...a_ValidatesRunner_Dataflow_Streaming_Engine.yml | 2 +-
...atesRunner_Dataflow_Streaming_TagEncodingV2.yml | 2 +-
...PostCommit_Java_ValidatesRunner_Dataflow_V2.yml | 2 +-
..._Java_ValidatesRunner_Dataflow_V2_Streaming.yml | 2 +-
...beam_PostCommit_Java_ValidatesRunner_Direct.yml | 2 +-
...it_Java_ValidatesRunner_Direct_JavaVersions.yml | 2 +-
.../beam_PostCommit_Java_ValidatesRunner_Flink.yml | 6 +-
.../beam_PostCommit_Java_ValidatesRunner_Spark.yml | 2 +-
...beam_PostCommit_Java_ValidatesRunner_Spark4.yml | 2 +-
...va_ValidatesRunner_SparkStructuredStreaming.yml | 2 +-
...am_PostCommit_Java_ValidatesRunner_Twister2.yml | 2 +-
.../beam_PostCommit_Java_ValidatesRunner_ULR.yml | 2 +-
.github/workflows/beam_PostCommit_Javadoc.yml | 2 +-
.../beam_PostCommit_PortableJar_Flink.yml | 2 +-
.../beam_PostCommit_PortableJar_Spark.yml | 2 +-
.github/workflows/beam_PostCommit_Python.yml | 2 +-
.github/workflows/beam_PostCommit_Python_Arm.yml | 4 +-
.../beam_PostCommit_Python_Dependency.yml | 2 +-
.../beam_PostCommit_Python_Examples_Dataflow.yml | 2 +-
.../beam_PostCommit_Python_Examples_Direct.yml | 2 +-
.../beam_PostCommit_Python_Examples_Flink.yml | 2 +-
.../beam_PostCommit_Python_Examples_Spark.yml | 2 +-
.../beam_PostCommit_Python_MongoDBIO_IT.yml | 2 +-
.../beam_PostCommit_Python_Nexmark_Direct.yml | 2 +-
.../beam_PostCommit_Python_Portable_Flink.yml | 2 +-
...stCommit_Python_ValidatesContainer_Dataflow.yml | 2 +-
..._Python_ValidatesContainer_Dataflow_With_RC.yml | 2 +-
..._PostCommit_Python_ValidatesRunner_Dataflow.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Flink.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Spark.yml | 2 +-
.../workflows/beam_PostCommit_Python_Versions.yml | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Dataflow.yml | 5 +-
.../beam_PostCommit_Python_Xlang_Gcp_Direct.yml | 3 +-
.../beam_PostCommit_Python_Xlang_IO_Dataflow.yml | 5 +-
.../beam_PostCommit_Python_Xlang_IO_Direct.yml | 6 +-
...m_PostCommit_Python_Xlang_Messaging_Direct.yml} | 22 +-
.github/workflows/beam_PostCommit_SQL.yml | 2 +-
.../beam_PostCommit_TransformService_Direct.yml | 8 +-
.github/workflows/beam_PostCommit_Website_Test.yml | 2 +-
.github/workflows/beam_PostCommit_XVR_Direct.yml | 3 +-
.github/workflows/beam_PostCommit_XVR_Flink.yml | 5 +-
.../beam_PostCommit_XVR_GoUsingJava_Dataflow.yml | 5 +-
...eam_PostCommit_XVR_JavaUsingPython_Dataflow.yml | 5 +-
..._PostCommit_XVR_PythonUsingJavaSQL_Dataflow.yml | 5 +-
...eam_PostCommit_XVR_PythonUsingJava_Dataflow.yml | 5 +-
.github/workflows/beam_PostCommit_XVR_Spark3.yml | 3 +-
.../beam_PostCommit_Yaml_Xlang_Direct.yml | 4 +-
.../workflows/beam_PostRelease_NightlySnapshot.yml | 2 +-
.../workflows/beam_PreCommit_CommunityMetrics.yml | 4 +-
.../workflows/beam_PreCommit_Flink_Container.yml | 10 +-
.github/workflows/beam_PreCommit_GHA.yml | 8 +-
.github/workflows/beam_PreCommit_Go.yml | 2 +-
.github/workflows/beam_PreCommit_GoPortable.yml | 2 +-
.github/workflows/beam_PreCommit_GoPrism.yml | 2 +-
.github/workflows/beam_PreCommit_ItFramework.yml | 2 +-
.github/workflows/beam_PreCommit_Java.yml | 2 +-
...eCommit_Java_Amazon-Web-Services2_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Amqp_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Azure_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Cassandra_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Cdap_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Clickhouse_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Csv_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Datadog_IO_Direct.yml | 2 +-
.github/workflows/beam_PreCommit_Java_Dataflow.yml | 2 +-
.../beam_PreCommit_Java_Debezium_IO_Direct.yml | 14 +-
.../beam_PreCommit_Java_Delta_IO_Direct.yml | 2 +-
...beam_PreCommit_Java_ElasticSearch_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Examples_Dataflow.yml | 2 +-
...am_PreCommit_Java_Examples_Dataflow_Java11.yml} | 20 +-
...Commit_Java_File-schema-transform_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Flink_Versions.yml | 4 +-
.../beam_PreCommit_Java_GCP_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Google-ads_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_HBase_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_HCatalog_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Hadoop_IO_Direct.yml | 2 +-
.../workflows/beam_PreCommit_Java_IOs_Direct.yml | 15 +-
.../beam_PreCommit_Java_InfluxDb_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_JDBC_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Jms_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Kafka_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Kudu_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_MongoDb_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Mqtt_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Neo4j_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_PVR_Flink_Batch.yml | 4 +-
.../beam_PreCommit_Java_PVR_Flink_Docker.yml | 4 +-
.../beam_PreCommit_Java_PVR_Prism_Loopback.yml | 2 +-
.../beam_PreCommit_Java_Parquet_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Pulsar_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_RabbitMq_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Redis_IO_Direct.yml | 2 +-
...am_PreCommit_Java_RequestResponse_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_SingleStore_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Snowflake_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Solace_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Solr_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Spark_Versions.yml | 6 +-
.../beam_PreCommit_Java_Splunk_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Thrift_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Tika_IO_Direct.yml | 2 +-
.../workflows/beam_PreCommit_Kotlin_Examples.yml | 10 +-
.../workflows/beam_PreCommit_Portable_Python.yml | 2 +-
.github/workflows/beam_PreCommit_Prism_Python.yml | 2 +-
.github/workflows/beam_PreCommit_Python.yml | 2 +-
.github/workflows/beam_PreCommit_PythonDocker.yml | 4 +-
.github/workflows/beam_PreCommit_PythonDocs.yml | 2 +-
.../workflows/beam_PreCommit_PythonFormatter.yml | 2 +-
.github/workflows/beam_PreCommit_PythonLint.yml | 2 +-
.../workflows/beam_PreCommit_Python_Coverage.yml | 2 +-
.../workflows/beam_PreCommit_Python_Dataframes.yml | 2 +-
.github/workflows/beam_PreCommit_Python_Dill.yml | 2 +-
.../workflows/beam_PreCommit_Python_Examples.yml | 2 +-
.../beam_PreCommit_Python_Integration.yml | 2 +-
.github/workflows/beam_PreCommit_Python_ML.yml | 2 +-
.../workflows/beam_PreCommit_Python_PVR_Flink.yml | 2 +-
.../workflows/beam_PreCommit_Python_Runners.yml | 2 +-
.../workflows/beam_PreCommit_Python_Transforms.yml | 2 +-
.github/workflows/beam_PreCommit_RAT.yml | 2 +-
.github/workflows/beam_PreCommit_SQL.yml | 2 +-
.github/workflows/beam_PreCommit_SQL_Java17.yml | 2 +-
.github/workflows/beam_PreCommit_Spotless.yml | 2 +-
.github/workflows/beam_PreCommit_Typescript.yml | 2 +-
.github/workflows/beam_PreCommit_Website.yml | 2 +-
.../workflows/beam_PreCommit_Website_Stage_GCS.yml | 2 +-
.github/workflows/beam_PreCommit_Whitespace.yml | 2 +-
.../beam_PreCommit_Xlang_Generated_Transforms.yml | 2 +-
.../workflows/beam_PreCommit_Yaml_Xlang_Direct.yml | 4 +-
.github/workflows/beam_Prober_CommunityMetrics.yml | 2 +-
.github/workflows/beam_Publish_BeamMetrics.yml | 2 +-
.../workflows/beam_Publish_Beam_SDK_Snapshots.yml | 6 +-
.../workflows/beam_Publish_Docker_Snapshots.yml | 6 +-
...Jobs.yml => beam_Publish_Python_VLLM_Image.yml} | 71 +-
.github/workflows/beam_Publish_Website.yml | 4 +-
.../beam_Python_CostBenchmarks_Dataflow.yml | 2 +-
...beam_Python_ValidatesContainer_Dataflow_ARM.yml | 4 +-
.github/workflows/beam_Release_NightlySnapshot.yml | 2 +-
.../beam_Release_Python_NightlySnapshot.yml | 2 +-
.../workflows/beam_StressTests_Java_BigQueryIO.yml | 2 +-
.../workflows/beam_StressTests_Java_BigTableIO.yml | 2 +-
.../workflows/beam_StressTests_Java_KafkaIO.yml | 2 +-
.../workflows/beam_StressTests_Java_PubSubIO.yml | 2 +-
.../workflows/beam_StressTests_Java_SpannerIO.yml | 2 +-
.github/workflows/beam_Upgrade_GCP_BOM.yml | 94 ++
.github/workflows/build_release_candidate.yml | 30 +-
.github/workflows/build_runner_image.yml | 8 +-
.github/workflows/build_wheels.yml | 8 +-
.github/workflows/cancel.yml | 2 +-
.github/workflows/code_completion_plugin_tests.yml | 4 +-
.github/workflows/codeql.yml | 2 +-
.github/workflows/cut_release_branch.yml | 9 +-
.github/workflows/dask_runner_tests.yml | 4 +-
.../workflows/deploy_release_candidate_pypi.yaml | 2 +-
.github/workflows/finalize_release.yml | 8 +-
.github/workflows/flaky_test_detection.yml | 2 +-
.github/workflows/git_tag_released_version.yml | 2 +-
.github/workflows/go_tests.yml | 2 +-
.github/workflows/issue-tagger.yml | 2 +-
.github/workflows/java_tests.yml | 4 +-
...flow_MLTransform_Image_Embedding_CPU_Batch.txt} | 38 +-
...flow_MLTransform_Image_Embedding_GPU_Batch.txt} | 40 +-
...Dataflow_MLTransform_One_Hot_Encoding_Batch.txt | 2 +-
..._Dataflow_MLTransform_Text_Embedding_Batch.txt} | 40 +-
.github/workflows/local_env_tests.yml | 4 +-
.github/workflows/playground_frontend_test.yml | 4 +-
.github/workflows/pr-bot-new-prs.yml | 2 +-
.github/workflows/pr-bot-pr-updates.yml | 2 +-
.github/workflows/pr-bot-prs-needing-attention.yml | 2 +-
.github/workflows/publish_github_release_notes.yml | 4 +-
.github/workflows/python_dependency_tests.yml | 2 +-
.github/workflows/python_tests.yml | 8 +-
.github/workflows/refresh_looker_metrics.yml | 2 +-
.github/workflows/reportGenerator.yml | 2 +-
.../republish_released_docker_containers.yml | 4 +-
.github/workflows/run_perf_alert_tool.yml | 2 +-
.../workflows/run_rc_validation_go_wordcount.yml | 4 +-
.../run_rc_validation_java_mobile_gaming.yml | 2 +-
.../run_rc_validation_java_quickstart.yml | 4 +-
.../run_rc_validation_python_mobile_gaming.yml | 2 +-
.../workflows/run_rc_validation_python_yaml.yml | 2 +-
.github/workflows/tour_of_beam_backend.yml | 2 +-
.../workflows/tour_of_beam_backend_integration.yml | 2 +-
.github/workflows/tour_of_beam_frontend_test.yml | 4 +-
.github/workflows/typescript_tests.yml | 18 +-
.github/workflows/update_python_dependencies.yml | 4 +-
.test-infra/dataproc/flink_cluster.sh | 84 +-
.test-infra/dataproc/init-actions/docker.sh | 103 --
.test-infra/dataproc/init-actions/flink.sh | 217 ---
.test-infra/tools/refresh_looker_metrics.py | 5 +-
.test-infra/validate-runner/build.gradle | 13 +
CHANGES.md | 64 +-
build.gradle.kts | 7 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 43 +-
contributor-docs/release-guide.md | 12 +-
examples/java/build.gradle | 7 +
examples/java/common.gradle | 2 +
examples/kotlin/build.gradle | 7 +
gradle.properties | 6 +-
infra/enforcement/README.md | 12 +-
infra/enforcement/account_keys.py | 103 +-
infra/enforcement/sending.py | 105 +-
infra/iam/roles/roles_config.yaml | 2 +-
.../beam/model/fn_execution/v1/beam_fn_api.proto | 38 +-
.../beam/model/pipeline/v1/beam_runner_api.proto | 4 +
.../life_cycle/life_cycle_setuper_test.go | 3 +-
release/build.gradle.kts | 2 +-
.../org/apache/beam/runners/core/DoFnRunners.java | 4 +-
.../runners/core/LateDataDroppingDoFnRunner.java | 17 +-
.../apache/beam/runners/core/ReduceFnRunner.java | 3 +-
.../core/LateDataDroppingDoFnRunnerTest.java | 4 +-
.../apache/beam/runners/core/ReduceFnTester.java | 20 +-
.../direct/ExecutorServiceParallelExecutor.java | 28 +-
runners/flink/1.17/build.gradle | 25 -
runners/flink/1.18/build.gradle | 25 -
.../flink/streaming/MemoryStateBackendWrapper.java | 80 --
.../runners/flink/streaming/StreamSources.java | 61 -
.../FlinkStreamingPortablePipelineTranslator.java | 1 -
.../functions/FlinkExecutableStageFunction.java | 19 +-
runners/flink/{2.0 => 2.1}/build.gradle | 11 +-
.../job-server-container/build.gradle | 0
.../flink/{1.17 => 2.1}/job-server/build.gradle | 9 +-
runners/flink/{2.0 => 2.2}/build.gradle | 26 +-
.../job-server-container/build.gradle | 0
.../flink/{1.18 => 2.2}/job-server/build.gradle | 9 +-
.../runners/flink/FlinkExecutionEnvironments.java | 4 +-
.../wrappers/streaming/DoFnOperator.java | 2 +-
.../runners/flink/FlinkPipelineOptionsTest.java | 16 +-
runners/flink/job-server/flink_job_server.gradle | 22 +-
.../runners/flink/FlinkDetachedRunnerResult.java | 60 +-
.../beam/runners/flink/FlinkRunnerResult.java | 6 +
.../FlinkStreamingPortablePipelineTranslator.java | 1 -
.../functions/FlinkExecutableStageFunction.java | 19 +-
.../streaming/ExecutableStageDoFnOperator.java | 18 +-
.../wrappers/streaming/WindowDoFnOperator.java | 2 +-
.../beam/runners/flink/FlinkRunnerResultTest.java | 92 ++
.../flink/streaming/MemoryStateBackendWrapper.java | 28 +-
.../runners/flink/streaming/StreamSources.java | 7 +
runners/google-cloud-dataflow-java/build.gradle | 10 +-
.../beam/runners/dataflow/DataflowPipelineJob.java | 67 +-
.../options/DataflowStreamingPipelineOptions.java | 19 +-
.../options/DataflowWorkerLoggingOptions.java | 56 +-
.../runners/dataflow/DataflowPipelineJobTest.java | 46 +
.../dataflow/worker/GroupAlsoByWindowsParDoFn.java | 2 +-
.../dataflow/worker/StreamingDataflowWorker.java | 8 +
.../worker/StreamingModeExecutionContext.java | 390 +++++-
.../worker/WindmillReaderIteratorBase.java | 29 +-
.../dataflow/worker/WindmillTimerInternals.java | 23 +
.../dataflow/worker/WindowingWindmillReader.java | 119 +-
.../logging/DataflowWorkerLoggingInitializer.java | 12 +-
.../worker/streaming/ComputationWorkExecutor.java | 43 +-
.../runners/dataflow/worker/streaming/Work.java | 29 +-
.../FanOutStreamingEngineWorkerHarness.java | 7 +-
.../windmill/client/grpc/GrpcCommitWorkStream.java | 94 +-
.../client/grpc/GrpcWindmillStreamFactory.java | 10 +
.../windmill/state/WindmillStateInternals.java | 17 +
.../processing/ComputationWorkExecutorFactory.java | 33 +-
.../work/processing/StreamingWorkScheduler.java | 312 +++--
.../worker/StreamingDataflowWorkerTest.java | 36 +-
.../worker/StreamingGroupAlsoByWindowFnsTest.java | 3 +-
.../worker/StreamingModeExecutionContextTest.java | 158 ++-
.../worker/WindmillReaderIteratorBaseTest.java | 92 ++
.../worker/WindowingWindmillReaderTest.java | 275 ++++
.../dataflow/worker/WorkerCustomSourcesTest.java | 51 +-
.../DataflowWorkerLoggingInitializerTest.java | 44 +-
.../dataflow/worker/streaming/WorkTest.java | 132 ++
.../client/grpc/GrpcCommitWorkStreamTest.java | 82 ++
.../control/BundleCheckpointHandlers.java | 24 +-
.../fnexecution/control/SdkHarnessClient.java | 2 +-
.../runners/fnexecution/data/FnDataService.java | 3 +-
.../runners/fnexecution/data/GrpcDataService.java | 13 +-
.../runners/fnexecution/ServerFactoryTest.java | 19 +-
.../control/BundleCheckpointHandlersTest.java | 125 ++
.../fnexecution/data/GrpcDataServiceTest.java | 2 +-
runners/spark/spark_runner.gradle | 5 +-
scripts/beam-sql.sh | 75 +-
scripts/ci/issue-report/package-lock.json | 14 +-
scripts/ci/issue-report/package.json | 2 +-
scripts/tools/bomupgrader.py | 69 +-
sdks/go.mod | 76 +-
sdks/go.sum | 156 +--
sdks/go/examples/wasm/README.md | 6 +-
sdks/go/pkg/beam/core/core.go | 2 +-
sdks/go/test/build.gradle | 3 +
.../go/test/integration/io/xlang/jdbc/jdbc_test.go | 6 +-
.../java/org/apache/beam/sdk/PipelineResult.java | 13 +
.../sdk/fn/data/BeamFnDataGrpcMultiplexer.java | 2 +-
.../sdk/fn/data/BeamFnDataOutboundAggregator.java | 131 +-
.../org/apache/beam/sdk/io/CountingSource.java | 40 +-
.../apache/beam/sdk/transforms/AsyncWrapper.java | 10 +-
.../org/apache/beam/sdk/transforms/JsonToRow.java | 8 +-
.../java/org/apache/beam/sdk/util/ApiSurface.java | 7 +-
.../beam/sdk/util/construction/Environments.java | 1 +
.../fn/data/BeamFnDataOutboundAggregatorTest.java | 135 +-
.../org/apache/beam/sdk/io/CountingSourceTest.java | 36 +
.../sdk/options/PipelineOptionsFactoryTest.java | 56 +-
.../providers/JavaFilterTransformProviderTest.java | 8 +-
.../beam/sdk/transforms/AsyncWrapperTest.java | 109 +-
.../apache/beam/sdk/transforms/JsonToRowTest.java | 26 +
.../beam/sdk/util/common/ReflectHelpersTest.java | 15 +-
sdks/java/extensions/arrow/build.gradle | 7 +-
sdks/java/extensions/avro/build.gradle | 7 +
.../opentelemetry-gcp-auth-extension/build.gradle | 1 +
.../opentelemetry/gcp/auth/ConfigurableOption.java | 1 +
...GcpAuthAutoConfigurationCustomizerProvider.java | 196 +--
...nfigure.spi.AutoConfigurationCustomizerProvider | 16 -
...uthAutoConfigurationCustomizerProviderTest.java | 276 ++--
.../meta/provider/iceberg/IcebergMetastore.java | 8 +-
.../provider/iceberg/IcebergMetastoreTest.java | 13 +
.../impl/transform/BeamBuiltinAggregations.java | 2 +
.../sql/impl/transform/agg/VarianceFn.java | 38 +-
.../sql/BeamSqlDslAggregationVarianceTest.java | 43 +-
.../sql/impl/transform/agg/VarianceFnTest.java | 25 +-
.../java/org/apache/beam/fn/harness/FnHarness.java | 55 +-
.../fn/harness/control/ProcessBundleHandler.java | 50 +-
.../beam/fn/harness/data/BeamFnDataClient.java | 28 +-
.../beam/fn/harness/data/BeamFnDataGrpcClient.java | 91 +-
.../beam/fn/harness/BeamFnDataWriteRunnerTest.java | 44 +-
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 2 +-
.../PTransformRunnerFactoryTestContext.java | 12 +-
.../harness/control/ProcessBundleHandlerTest.java | 47 +-
.../fn/harness/data/BeamFnDataGrpcClientTest.java | 41 +-
.../sdk/io/aws2/sqs/SqsIOWriteBatchesTest.java | 97 +-
sdks/java/io/cassandra/build.gradle | 21 +
sdks/java/io/cdap/build.gradle | 5 +
.../beam/sdk/io/clickhouse/ClickHouseIO.java | 3 +
.../beam/sdk/io/clickhouse/ClickHouseWriter.java | 40 +
.../apache/beam/sdk/io/clickhouse/TableSchema.java | 53 +-
.../clickhouse/src/main/javacc/ColumnTypeParser.jj | 27 +
.../beam/sdk/io/clickhouse/ClickHouseIOIT.java | 119 ++
.../sdk/io/clickhouse/ClickHouseWriterTest.java | 141 ++
.../beam/sdk/io/clickhouse/TableSchemaTest.java | 102 ++
.../components/throttling/AdaptiveThrottler.java | 105 ++
.../components/throttling/ReactiveThrottler.java | 78 ++
.../throttling/AdaptiveThrottlerTest.java | 107 ++
.../org/apache/beam/sdk/io/csv/CsvIOParseTest.java | 6 +-
.../DeltaReadSchemaTransformProviderTest.java | 127 ++
sdks/java/io/expansion-service/build.gradle | 1 +
sdks/java/io/google-cloud-platform/build.gradle | 1 +
.../sdk/io/gcp/datastore/AdaptiveThrottler.java | 111 --
.../beam/sdk/io/gcp/datastore/DatastoreV1.java | 1 +
.../beam/sdk/io/gcp/pubsub/ExternalWrite.java | 6 +
.../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java | 5 +-
.../beam/sdk/io/gcp/spanner/SpannerAccessor.java | 13 +-
.../beam/sdk/io/gcp/spanner/SpannerConfig.java | 37 +
.../apache/beam/sdk/io/gcp/spanner/SpannerIO.java | 171 ++-
.../io/gcp/spanner/SpannerTransformRegistrar.java | 30 +
.../MetadataSpannerConfigFactory.java | 6 +
.../io/gcp/datastore/AdaptiveThrottlerTest.java | 114 --
.../beam/sdk/io/gcp/spanner/SpannerReadIT.java | 33 +-
.../beam/sdk/io/gcp/spanner/SpannerTestHelper.java | 110 ++
.../beam/sdk/io/gcp/spanner/SpannerWriteIT.java | 110 +-
.../changestreams/it/IntegrationTestEnv.java | 17 +-
.../changestreams/it/SpannerChangeStreamIT.java | 19 +-
...StreamOrderedByTimestampAndTransactionIdIT.java | 10 +-
...nnerChangeStreamOrderedWithinKeyGloballyIT.java | 10 +-
.../it/SpannerChangeStreamOrderedWithinKeyIT.java | 10 +-
.../it/SpannerChangeStreamPlacementTableIT.java | 19 +-
...pannerChangeStreamPlacementTablePostgresIT.java | 10 +-
.../it/SpannerChangeStreamPostgresIT.java | 10 +-
...SpannerChangeStreamTransactionBoundariesIT.java | 10 +-
.../it/SpannerChangeStreamsSchemaTransformIT.java | 4 +
.../org/apache/beam/sdk/io/iceberg/AddFiles.java | 39 +-
.../beam/sdk/io/iceberg/IcebergCatalogConfig.java | 2 +-
.../beam/sdk/io/iceberg/IcebergScanConfig.java | 78 +-
.../apache/beam/sdk/io/iceberg/PartitionUtils.java | 100 +-
.../apache/beam/sdk/io/iceberg/ReadFromTasks.java | 4 +-
.../org/apache/beam/sdk/io/iceberg/ReadUtils.java | 137 +-
.../beam/sdk/io/iceberg/RecordWriterManager.java | 5 +-
.../apache/beam/sdk/io/iceberg/ScanTaskReader.java | 4 +-
.../beam/sdk/io/iceberg/SerializableDataFile.java | 100 +-
.../sdk/io/iceberg/SerializableDeleteFile.java | 335 +++++
.../beam/sdk/io/iceberg/cdc/CdcOutputUtils.java | 178 +++
.../beam/sdk/io/iceberg/cdc/CdcReadUtils.java | 698 ++++++++++
.../beam/sdk/io/iceberg/cdc/DeleteReader.java | 309 +++++
.../io/iceberg/cdc/IcebergCdcMetadataColumns.java | 93 ++
.../io/iceberg/cdc/SerializableChangelogTask.java | 282 ++++
.../beam/sdk/io/iceberg/cdc}/package-info.java | 4 +-
.../iceberg/BaseIncrementalChangelogScan.java | 1014 ++++++++++++++
.../java/org/apache/iceberg}/package-info.java | 4 +-
.../IcebergCdcReadSchemaTransformProviderTest.java | 12 +-
.../beam/sdk/io/iceberg/IcebergIOReadTest.java | 83 +-
.../IcebergSchemaTransformTranslationTest.java | 33 +-
.../beam/sdk/io/iceberg/PartitionUtilsTest.java | 68 +
.../apache/beam/sdk/io/iceberg/ReadUtilsTest.java | 59 +-
.../sdk/io/iceberg/SerializableDataFileTest.java | 3 +
.../sdk/io/iceberg/SerializableDeleteFileTest.java | 222 ++++
.../beam/sdk/io/iceberg/TestDataWarehouse.java | 2 +-
.../io/iceberg/catalog/IcebergCatalogBaseIT.java | 7 +-
.../beam/sdk/io/iceberg/cdc/CdcReadUtilsTest.java | 381 ++++++
.../beam/sdk/io/iceberg/cdc/DeleteReaderTest.java | 419 ++++++
.../iceberg/cdc/SerializableChangelogTaskTest.java | 256 ++++
sdks/java/io/influxdb/build.gradle | 10 +-
.../apache/beam/sdk/io/influxdb/InfluxDbIO.java | 22 +
.../beam/sdk/io/influxdb/InfluxDbIOTest.java | 104 +-
sdks/java/io/kafka/build.gradle | 1 +
sdks/java/io/mongodb/build.gradle | 2 +
.../beam/sdk/io/mongodb/AggregationQuery.java | 9 +-
...> MongoDbReadSchemaTransformConfiguration.java} | 34 +-
.../MongoDbReadSchemaTransformProvider.java | 151 +++
.../apache/beam/sdk/io/mongodb/MongoDbUtils.java | 131 ++
.../MongoDbReadSchemaTransformProviderTest.java | 221 ++++
.../beam/sdk/io/mongodb/MongoDbUtilsTest.java | 123 ++
sdks/java/io/mqtt/build.gradle | 3 +-
.../java/org/apache/beam/sdk/io/mqtt/MqttIO.java | 182 +--
.../org/apache/beam/sdk/io/mqtt/MqttIOTest.java | 204 +--
.../org/apache/beam/sdk/io/parquet/ParquetIO.java | 47 +
.../org/apache/beam/io/requestresponse/Call.java | 1 +
.../apache/beam/io/requestresponse/CallTest.java | 53 +-
.../singlestore/SingleStoreDefaultRowMapper.java | 3 +-
sdks/java/ml/inference/remote/build.gradle | 1 +
.../sdk/ml/inference/remote/RemoteInference.java | 135 +-
.../beam/sdk/ml/inference/remote/RetryHandler.java | 27 +-
.../ml/inference/remote/RemoteInferenceTest.java | 140 +-
.../sdk/ml/inference/remote/RetryHandlerTest.java | 145 ++
sdks/java/testing/nexmark/build.gradle | 15 +
sdks/java/testing/tpcds/build.gradle | 15 +
.../controller-container/Dockerfile | 2 +-
sdks/python/.yapfignore | 1 +
sdks/python/apache_beam/dataframe/frames.py | 7 +-
sdks/python/apache_beam/dataframe/frames_test.py | 4 +-
.../online_clustering/clustering_pipeline/setup.py | 2 +-
.../examples/inference/vllm_text_completion.py | 24 +-
.../mltransform_generate_vocab_requirements.txt | 10 +-
.../ml_transform/mltransform_image_embedding.py | 263 ++++
.../mltransform_image_embedding_test.py | 105 ++
.../mltransform_one_hot_encoding_requirements.txt} | 16 +-
.../mltransform_one_hot_encoding_test.py | 2 -
.../ml_transform/mltransform_text_embedding.py | 186 +++
.../mltransform_text_embedding_test.py | 94 ++
.../wordcount_rust/word_processing/Cargo.lock | 65 +-
.../wordcount_rust/word_processing/Cargo.toml | 2 +-
.../apache_beam/io/components/rate_limit.proto | 64 +
.../apache_beam/io/components/rate_limit_pb2.py | 63 +
.../apache_beam/io/components/rate_limiter.py | 39 +-
.../apache_beam/io/components/rate_limiter_test.py | 62 +-
sdks/python/apache_beam/io/external/gcp/pubsub.py | 11 +-
.../io/external/xlang_mqttio_it_test.py | 268 ++++
.../apache_beam/io/gcp/bigquery_file_loads.py | 2 +-
sdks/python/apache_beam/io/gcp/gcsio.py | 61 +-
.../apache_beam/io/gcp/gcsio_integration_test.py | 21 +-
sdks/python/apache_beam/io/gcp/gcsio_test.py | 132 ++
sdks/python/apache_beam/io/gcp/pubsub.py | 48 +-
.../apache_beam/io/gcp/pubsub_integration_test.py | 100 ++
sdks/python/apache_beam/io/gcp/pubsub_test.py | 151 ++-
sdks/python/apache_beam/io/iobase.py | 14 +-
sdks/python/apache_beam/io/iobase_test.py | 49 +-
sdks/python/apache_beam/io/requestresponse.py | 5 +-
sdks/python/apache_beam/io/requestresponse_test.py | 10 +
sdks/python/apache_beam/io/unbounded_source.py | 996 ++++++++++++++
.../python/apache_beam/io/unbounded_source_test.py | 1380 ++++++++++++++++++++
sdks/python/apache_beam/ml/inference/base.py | 6 +
sdks/python/apache_beam/ml/inference/base_test.py | 2 +-
.../ml/inference/pytorch_inference_test.py | 5 +-
.../ml/inference/sklearn_inference_test.py | 4 +-
.../ml/inference/tensorflow_inference_test.py | 4 +-
.../ml/inference/tensorrt_inference_test.py | 11 +-
.../inference/test_resources/vllm.dockerfile.old | 14 +-
.../apache_beam/ml/inference/vllm_inference.py | 331 ++++-
.../ml/inference/vllm_inference_test.py | 157 +++
.../ml/rag/enrichment/milvus_search_it_test.py | 1 +
.../ml/rag/ingestion/milvus_search_it_test.py | 1 +
sdks/python/apache_beam/ml/rag/test_utils.py | 1 +
.../mltransform_embedding_tests_requirements.txt} | 5 +-
.../python/apache_beam/options/pipeline_options.py | 2 +-
.../apache_beam/runners/dataflow/internal/names.py | 2 +-
.../runners/direct/transform_evaluator.py | 113 +-
.../apache_beam/runners/worker/bundle_processor.py | 37 +-
.../runners/worker/statesampler_fast.pyx | 11 +-
.../benchmarks/cloudml/criteo_tft/criteo.py | 30 +-
.../benchmarks/cloudml/criteo_tft/criteo_test.py | 93 ++
.../testing/benchmarks/cloudml/requirements.txt | 16 +-
.../mltransform_image_embedding_benchmark.py | 128 ++
.../mltransform_one_hot_encoding_benchmark.py | 79 +-
.../mltransform_text_embedding_benchmark.py | 117 ++
.../testing/load_tests/dataflow_cost_benchmark.py | 143 +-
sdks/python/apache_beam/transforms/async_dofn.py | 4 +-
.../apache_beam/transforms/async_dofn_test.py | 47 +
sdks/python/apache_beam/transforms/external.py | 1 +
sdks/python/apache_beam/transforms/managed.py | 4 +-
sdks/python/apache_beam/transforms/stats_test.py | 20 +-
.../apache_beam/transforms/userstate_test.py | 69 +
sdks/python/apache_beam/transforms/util_test.py | 49 +
sdks/python/apache_beam/utils/subprocess_server.py | 89 +-
.../apache_beam/utils/subprocess_server_test.py | 22 +-
sdks/python/apache_beam/version.py | 2 +-
sdks/python/apache_beam/yaml/examples/README.md | 4 +
.../yaml/extended_tests/databases/iceberg.yaml | 54 +-
sdks/python/apache_beam/yaml/integration_tests.py | 96 ++
sdks/python/apache_beam/yaml/main.py | 7 +-
sdks/python/apache_beam/yaml/standard_io.yaml | 15 +-
.../python/apache_beam/yaml/tests/delta.yaml | 24 +-
sdks/python/apache_beam/yaml/tests/mongodb.yaml | 40 +-
sdks/python/apache_beam/yaml/yaml_io.py | 103 +-
sdks/python/apache_beam/yaml/yaml_io_test.py | 103 ++
sdks/python/apache_beam/yaml/yaml_provider.py | 11 +-
sdks/python/apache_beam/yaml/yaml_transform.py | 56 +-
.../python/apache_beam/yaml/yaml_transform_test.py | 119 ++
.../container/ml/py310/base_image_requirements.txt | 79 +-
.../container/ml/py310/gpu_image_requirements.txt | 101 +-
.../container/ml/py311/base_image_requirements.txt | 81 +-
.../container/ml/py311/gpu_image_requirements.txt | 103 +-
.../container/ml/py312/base_image_requirements.txt | 83 +-
.../container/ml/py312/gpu_image_requirements.txt | 105 +-
.../container/ml/py313/base_image_requirements.txt | 83 +-
.../container/py310/base_image_requirements.txt | 73 +-
.../container/py311/base_image_requirements.txt | 75 +-
.../container/py312/base_image_requirements.txt | 77 +-
.../container/py313/base_image_requirements.txt | 77 +-
.../container/py314/base_image_requirements.txt | 75 +-
sdks/python/pyproject.toml | 3 +-
sdks/python/pytest.ini | 1 +
sdks/python/scripts/run_integration_test.sh | 11 +-
sdks/python/scripts/run_lint.sh | 1 +
sdks/python/setup.py | 15 +-
sdks/python/test-suites/dataflow/common.gradle | 50 +-
sdks/python/test-suites/direct/build.gradle | 6 +
sdks/python/test-suites/xlang/build.gradle | 8 +-
sdks/standard_expansion_services.yaml | 1 +
sdks/standard_external_transforms.yaml | 34 +
sdks/typescript/package-lock.json | 43 +-
sdks/typescript/package.json | 4 +-
sdks/typescript/src/apache_beam/runners/flink.ts | 2 +-
settings.gradle.kts | 2 +-
website/www/site/assets/js/bootstrap.js | 46 +-
website/www/site/assets/js/bootstrap/alert.js | 7 +-
website/www/site/assets/js/bootstrap/carousel.js | 9 +-
website/www/site/assets/js/bootstrap/collapse.js | 6 +-
website/www/site/assets/js/bootstrap/dropdown.js | 7 +-
website/www/site/assets/js/bootstrap/modal.js | 8 +-
website/www/site/assets/js/bootstrap/tooltip.js | 9 +-
website/www/site/assets/js/page-nav.js | 2 +-
website/www/site/config.toml | 2 +-
website/www/site/content/en/blog/beam-2.68.0.md | 2 +-
website/www/site/content/en/blog/beam-2.75.0.md | 72 +
.../site/content/en/documentation/dsls/sql/ddl.md | 2 +-
.../dsls/sql/extensions/create-external-table.md | 52 -
.../site/content/en/documentation/io/connectors.md | 12 +-
.../site/content/en/documentation/io/managed-io.md | 546 ++++----
.../site/content/en/documentation/runners/flink.md | 14 +-
.../site/content/en/documentation/sdks/python.md | 6 +-
.../www/site/content/en/documentation/sdks/yaml.md | 34 +
.../www/site/content/en/get-started/downloads.md | 18 +-
.../site/content/en/get-started/quickstart-py.md | 2 +-
website/www/site/content/en/performance/_index.md | 3 +
.../mltransform-image-embedding-cpu/_index.md | 48 +
.../mltransform-image-embedding-gpu/_index.md | 48 +
.../_index.md | 24 +-
website/www/site/data/performance.yaml | 49 +-
website/www/yarn.lock | 6 +-
725 files changed, 20004 insertions(+), 4745 deletions(-)
copy .github/trigger_files/{beam_PostCommit_Java_Nexmark_Flink.json =>
beam_PostCommit_Java_Tpcds_Flink.json} (100%)
copy
.github/trigger_files/{beam_PostCommit_Python_ValidatesRunner_Dataflow.json =>
beam_PostCommit_Python_Xlang_Messaging_Direct.json} (100%)
delete mode 100644 .github/trigger_files/beam_PostCommit_XVR_Samza.json
create mode 100644 .github/workflows/beam_Infrastructure_AuditUnmanagedKeys.yml
copy .github/workflows/{beam_PostCommit_Python_Xlang_IO_Direct.yml =>
beam_PostCommit_Python_Xlang_Messaging_Direct.yml} (84%)
rename .github/workflows/{beam_PreCommit_Java_Examples_Dataflow_Java21.yml =>
beam_PreCommit_Java_Examples_Dataflow_Java11.yml} (91%)
copy .github/workflows/{beam_CancelStaleDataflowJobs.yml =>
beam_Publish_Python_VLLM_Image.yml} (55%)
create mode 100644 .github/workflows/beam_Upgrade_GCP_BOM.yml
copy
.github/workflows/load-tests-pipeline-options/{beam_Inference_Python_Benchmarks_Dataflow_Table_Row_Inference_Stream.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_MLTransform_Image_Embedding_CPU_Batch.txt}
(59%)
copy
.github/workflows/load-tests-pipeline-options/{beam_Inference_Python_Benchmarks_Dataflow_Table_Row_Inference_Stream.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_MLTransform_Image_Embedding_GPU_Batch.txt}
(54%)
copy
.github/workflows/load-tests-pipeline-options/{beam_Inference_Python_Benchmarks_Dataflow_MLTransform_Generate_Vocab_Batch.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_MLTransform_Text_Embedding_Batch.txt}
(62%)
delete mode 100644 .test-infra/dataproc/init-actions/docker.sh
delete mode 100644 .test-infra/dataproc/init-actions/flink.sh
delete mode 100644 runners/flink/1.17/build.gradle
delete mode 100644 runners/flink/1.18/build.gradle
delete mode 100644
runners/flink/1.19/src/test/java/org/apache/beam/runners/flink/streaming/MemoryStateBackendWrapper.java
delete mode 100644
runners/flink/1.19/src/test/java/org/apache/beam/runners/flink/streaming/StreamSources.java
copy runners/flink/{2.0 => 2.1}/build.gradle (86%)
rename runners/flink/{1.17 => 2.1}/job-server-container/build.gradle (100%)
rename runners/flink/{1.17 => 2.1}/job-server/build.gradle (80%)
copy runners/flink/{2.0 => 2.2}/build.gradle (57%)
rename runners/flink/{1.18 => 2.2}/job-server-container/build.gradle (100%)
rename runners/flink/{1.18 => 2.2}/job-server/build.gradle (80%)
copy runners/flink/{2.0 =>
2.2}/src/main/java/org/apache/beam/runners/flink/FlinkExecutionEnvironments.java
(99%)
copy runners/flink/{2.0 =>
2.2}/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/DoFnOperator.java
(99%)
copy runners/flink/{2.0 =>
2.2}/src/test/java/org/apache/beam/runners/flink/FlinkPipelineOptionsTest.java
(92%)
create mode 100644
runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/WindowingWindmillReaderTest.java
create mode 100644
runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/streaming/WorkTest.java
create mode 100644
runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/control/BundleCheckpointHandlersTest.java
delete mode 100644
sdks/java/extensions/opentelemetry-gcp-auth-extension/src/main/resources/META-INF/services/io.opentelemetry.sdk.autoconfigure.spi.AutoConfigurationCustomizerProvider
create mode 100644
sdks/java/io/clickhouse/src/test/java/org/apache/beam/sdk/io/clickhouse/ClickHouseWriterTest.java
create mode 100644
sdks/java/io/components/src/main/java/org/apache/beam/sdk/io/components/throttling/AdaptiveThrottler.java
create mode 100644
sdks/java/io/components/src/main/java/org/apache/beam/sdk/io/components/throttling/ReactiveThrottler.java
create mode 100644
sdks/java/io/components/src/test/java/org/apache/beam/sdk/io/components/throttling/AdaptiveThrottlerTest.java
create mode 100644
sdks/java/io/delta/src/test/java/org/apache/beam/sdk/io/delta/DeltaReadSchemaTransformProviderTest.java
delete mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/AdaptiveThrottler.java
delete mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/datastore/AdaptiveThrottlerTest.java
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/spanner/SpannerTestHelper.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/SerializableDeleteFile.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/cdc/CdcOutputUtils.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/cdc/CdcReadUtils.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/cdc/DeleteReader.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/cdc/IcebergCdcMetadataColumns.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/cdc/SerializableChangelogTask.java
copy sdks/java/{core/jmh/src/main/java/org/apache/beam/sdk/jmh/io =>
io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/cdc}/package-info.java
(91%)
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/iceberg/BaseIncrementalChangelogScan.java
copy
{runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/state
=> sdks/java/io/iceberg/src/main/java/org/apache/iceberg}/package-info.java
(90%)
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/SerializableDeleteFileTest.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/cdc/CdcReadUtilsTest.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/cdc/DeleteReaderTest.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/cdc/SerializableChangelogTaskTest.java
copy
sdks/java/io/mongodb/src/main/java/org/apache/beam/sdk/io/mongodb/{MongoDbWriteSchemaTransformConfiguration.java
=> MongoDbReadSchemaTransformConfiguration.java} (69%)
create mode 100644
sdks/java/io/mongodb/src/main/java/org/apache/beam/sdk/io/mongodb/MongoDbReadSchemaTransformProvider.java
create mode 100644
sdks/java/io/mongodb/src/test/java/org/apache/beam/sdk/io/mongodb/MongoDbReadSchemaTransformProviderTest.java
create mode 100644
sdks/java/ml/inference/remote/src/test/java/org/apache/beam/sdk/ml/inference/remote/RetryHandlerTest.java
create mode 100644
sdks/python/apache_beam/examples/ml_transform/mltransform_image_embedding.py
create mode 100644
sdks/python/apache_beam/examples/ml_transform/mltransform_image_embedding_test.py
rename
sdks/python/apache_beam/{ml/transforms/mltransform_tests_requirements.txt =>
examples/ml_transform/mltransform_one_hot_encoding_requirements.txt} (82%)
create mode 100644
sdks/python/apache_beam/examples/ml_transform/mltransform_text_embedding.py
create mode 100644
sdks/python/apache_beam/examples/ml_transform/mltransform_text_embedding_test.py
create mode 100644 sdks/python/apache_beam/io/components/rate_limit.proto
create mode 100644 sdks/python/apache_beam/io/components/rate_limit_pb2.py
create mode 100644 sdks/python/apache_beam/io/external/xlang_mqttio_it_test.py
create mode 100644 sdks/python/apache_beam/io/unbounded_source.py
create mode 100644 sdks/python/apache_beam/io/unbounded_source_test.py
create mode 100644 sdks/python/apache_beam/ml/inference/vllm_inference_test.py
copy sdks/python/{.coveragerc =>
apache_beam/ml/transforms/mltransform_embedding_tests_requirements.txt} (91%)
create mode 100644
sdks/python/apache_beam/testing/benchmarks/cloudml/criteo_tft/criteo_test.py
create mode 100644
sdks/python/apache_beam/testing/benchmarks/inference/mltransform_image_embedding_benchmark.py
create mode 100644
sdks/python/apache_beam/testing/benchmarks/inference/mltransform_text_embedding_benchmark.py
copy
.test-infra/kafka/strimzi/02-kafka-persistent/overlays/gke-internal-load-balanced/kustomization.yaml
=> sdks/python/apache_beam/yaml/tests/delta.yaml (66%)
create mode 100644 website/www/site/content/en/blog/beam-2.75.0.md
create mode 100644
website/www/site/content/en/performance/mltransform-image-embedding-cpu/_index.md
create mode 100644
website/www/site/content/en/performance/mltransform-image-embedding-gpu/_index.md
copy website/www/site/content/en/performance/{mltransformonehot =>
mltransform-text-embedding}/_index.md (55%)
