This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/pip/sdks/python/apache_beam/examples/inference/large_language_modeling/transformers-4.53.0
in repository https://gitbox.apache.org/repos/asf/beam.git
omit 27dd8e7a1bc Bump transformers
add e410e34b067 Use consistent encoding for GBEK across languages (#36431)
add f973a4ed6c2 Add readme How to add a new ML benchmark pipeline
add 1b25848f658 Resolve comments
add 702d73ea50a Merge pull request #36437 from
apache/inference-benchmark-readme
add b5a0495e55b CombinePerKey with gbek (Java) (#36408)
add e3293e289e4 Minor changes on Managed JDBCIO (#36339)
add 67d469f43c1 Bump golang.org/x/sys from 0.36.0 to 0.37.0 in /sdks
(#36447)
add ff5eeeaf4b5 Bump golang.org/x/oauth2 from 0.30.0 to 0.31.0 in /sdks
(#36205)
add 4ff5fe7b5c8 Bump cloud.google.com/go/spanner from 1.85.1 to 1.86.0 in
/sdks (#36449)
add 116141a1f10 Bump gradle/wrapper-validation-action from 1.0.6 to 3.5.0
(#36278)
add ac4b5ab2aac Bump google.golang.org/api from 0.249.0 to 0.252.0 in
/sdks (#36450)
add 7e8ca06a1c9 Get viewer permissions for ksobrenat32 (#36458)
add 1e7167b6e6e Fix passing pipeline options to external transforms
(#36443)
add 6f31e56fcac Implement the member_type on the users.yml (#36460)
add 08c96f2c6e2 Fix XVR JavaUsingPython tests using dev Beam at expansion
(#36444)
add b2e123870f5 feat(pipeline_options): add support for custom maven
repository url (#36390)
add c5a61896433 [Dataflow Streaming] Fix outstanding bundle metric
reporting (#36455)
add 65ee22518ce [Dataflow Streaming] Move functionality creating windmill
tags to a common class. (#36283)
add b9f07c9dd29 [Spanner Change Streams] Ensure the partition watermark is
monotonic by reading within the transaction (#36463)
add b79d92fe01b Bump github.com/docker/docker in /sdks (#36468)
add 6683a1ae838 Bump golang.org/x/oauth2 from 0.31.0 to 0.32.0 in /sdks
(#36467)
add 893fc9a9b8f Update Go version to 1.25.2 (#36461)
add d4438b63e18 Enforce deterministic field order in Schema generated from
KafkaIO classes. (#36295)
add 590ece2cd8e Fix Python CoGBK Flink Batch config
add 62df216296a Merge pull request #36472 from apache/fix-flink-cogbk
add 227a6323ead Add logger helper functions from detectron2 (licensed as
Apache 2.0) (#36432)
add fb8058454c0 Refactor GBEK tests to split out secret setup for tests
that dont need it (#36479)
add bf4bf81922f Update CHANGES.md to show issue #36470 is fixed in 2.69.0
release. (#36477)
add a5846889716 [Dataflow Streaming] Change GrpcGetDataStream to backoff
requests that have been cancelled. (#36475)
add 6be76ae8542 [Dataflow Streaming] Enforce that get data requests for
the same work item are not batched. (#36474)
add 7735e7a3bd1 Bump google.golang.org/grpc from 1.75.1 to 1.76.0 in /sdks
(#36488)
add 2a77c59b82e Bump golang.org/x/text from 0.29.0 to 0.30.0 in /sdks
(#36487)
add 090b17bf535 added missing schemaFieldNumber annotation (#36489)
add 041e12edd9d feat: add warnings for public repository downloads in
multiple SDKs (#36476)
add 08b480000ec add generics support to AutoValueUtils helpers (#32977)
add c54cc2b6ed9 Add flag for disabling dill check in coders. (#36453)
add 1c6f779bdf2 Add use_gbek service option when gbek option used (#36452)
add d54a661f47e Bump golang.org/x/net from 0.45.0 to 0.46.0 in /sdks
(#36466)
add b9a89722d9e External metadata for streaming runner v1 changes (#36373)
add 243a52c5b42 Move tests running pipeline into a separate class for
PythonExternalTransformTest (#36492)
add b5b91810b76 Move the logic to LP TestStream encoded bytes to
preprocess steps. (#36465)
add 554a73b4bf3 Enable real-time clock in prism by default. (#36473)
add 2b9827b6c2d Refactor prism and go sdk logging and clean up messages
(#36484)
add 6dbbaa687fe Fix Credentials issue while commit (#36494)
add 385271bea45 Softens the GBEK determinism requirement (#36495)
add 72557e58a06 Only run Py39 and Py313 tests for PostCommit Arm (#36508)
add 91f79c3a97f Add GroupByEncryptedKey to changes (#36510)
add 673309b328c Call out OutputBuilder change in CHANGES.md (#36511)
add 37c7e28231b ci(python-deps): update transformers version constraints
in tox (#36506)
add 75eda20a901 Revert "Per element schema parsing in ConvertToBeamRows
(#36393)" (#36507)
add 7a9a4e6afa5 x-lang GroupByEncryptedKey (Java to Python) (#36418)
add 95dcaeac932 docs: Expose ReadChangeStreamFromSpanner in Beam Spanner
documentation (#36428)
add e94579a3e6c Enhance JAXBCoder with XMLInputFactory support (#36446)
add 7b34ab75c46 Add some x-lang gbek tests (Python to Java) (#36457)
add ed39cbbf709 beam-sql.sh, a standalone launcher for Beam SQL Shell
(#36305)
add 12a34c8acf8 Change default timeout and add heartbeat logging (#36517)
add 4add79cab24 Updates ExpansionService so that managed transforms can
use specific dependencies during expansion. Behavior is guarded by an pipeline
option.
add 50f578aee32 Merge pull request #36515: Updates ExpansionService so
that managed transforms can use specific dependencies during expansion
add 9ed06d081ec Handle null keys in gbek (#36505)
add c703b7227de Bump github.com/nats-io/nats.go from 1.46.0 to 1.47.0 in
/sdks (#36521)
add 99ee1738e2b Add a flag to control whether to allow splitting on sdf.
(#36512)
add d687f4fe817 Add GRPC experiments to Python dockerfile (#36525)
add f0c92c7a772 revert outputWindowedValue changes as there is
outputBuilder
add abf1904759e Merge pull request #36523: revert outputWindowedValue
changes from KafkaIO as there is outputBuilder
add ed39503878e Skip TestTimers_ProcessingTime_Unbounded for spark.
(#36527)
add 6ad53078c48 Moving to 2.70.0-SNAPSHOT on master branch.
add f7619c789d0 Update CHANGES.md to have fields for 2.70.0 release
add 6562b5b677d Update CHANGES.md to mention breakign change around
ProcessContext (#36530)
add 30fd958f5fc feat(bigquery): add GEOGRAPHY type support for BigQuery
I/O (#36121)
add b6878702484 Fix flaky tests caused by secret overlap (#36526)
add 96e79cba3a6 Concat protos in BQStorageWriteAPI - solve edge cases
during mering of nested repeated fields (#34436)
add 19fef1bba24 add changes comment on yaml output_schema (#36497)
add 57e34b6906b Fix proto map access. (#36532)
add faae168fa34 Bump github.com/aws/smithy-go from 1.23.0 to 1.23.1 in
/sdks (#36533)
add 118b3c7a582 PortableRunner tests: surface worker-thread exceptions on
main thread after wait_until_finish() (fixes #35211) (#36485)
add 5d420c5f047 Add pickler.roundtrip() shortcut for testing pickle
(#36441)
add 2b43f8018ba Pin specifiable test to FnApiRunner (#36536)
add f07ccf37cbe Track bundle processors that are pending creation and
terminate SDK if creating a BP exceeds a timeout. (#36518)
add 581ec8bb17f Always mark the instruction as cleaned up in the GRPC data
channel when processing an instruction fails. (#36367)
add e87f8097e53 Move setup/teardown to class level to avoid flakiness
(#36546)
add 6ffc68778b9 Fix build release candidate workflow (#36541)
add d91fb6d6987 Timeout execution tree creation for SDK worker ops.
(#36200)
add d4dc3243303 Fix dill tox (#36543)
add 34a6f542a7f Update beam_PreCommit_Python_ML.yml (#36550)
add 87db35637a6 Add "return []" to PGBK to silence warning (#36535)
add 2b666dacf47 test(bigquery): skip geography test when expansion jars
not available (#36555)
add d4b841caa94 Update changes.md with pickler changes. (#36558)
add 9030ba8074c test(bigquery): mock client in geography type support
tests (#36559)
add af748d07a1a Update Python Dependencies (#36560)
add 1bf56295bc9 Fix publishing of ml/distroless images (#36548)
add 07b321e5811 Fix unsafe container cleanup that could delete images from
other runs (#36547)
add e081879a78f Fix BigQueryIO File load validate runtime value provider
(#36564)
add ee48e713282 [3/3] sdks/python: enrich data with Milvus Search [Vector,
Keyword, Hybrid] (#35467)
add f8901e3a4c5 Update the release notes. (#36566)
add 15e8f98fed6 Fix dependency version (#36568)
add d0d0cd8c2f1 Revert "Add GRPC experiments to Python dockerfile
(#36525)" (#36572)
add 944eef91344 Upload beam blog. (#36499)
add c22665c5111 Call now() once so start and end have exactly the same
base timestamp. (#36574)
add 0d52be60e88 Add image generation code to Gemini Model Handler (#36177)
add 179d4d1ee9c Fix flaky tests (#36579)
add 7e7d866d95a [python] add setup to BigQuery's convert row Map transform
(#36502)
add c7d920f26cf Update dev image. (#36582)
add 243d4077319 Integrate lambda name pickling with Cloudpickle (#35904)
add ab892e3dd09 Add logging for credential retrieval failures in
GcpCredentialFactory
add db92a3ad0c0 Merge pull request #36415: Add logging for credential
retrieval failures in GcpCredentialFactory
add b83c24e4d45 test(spannerio): make batch size validation more flexible
for non-deterministic execution (#36584)
add 4c08585626b [IcebergIO] Pass table props to data writers (#36542)
add 0ebf84b6b18 Add ib.collect support for raw records (#36516)
add 38481b58879 Address circular dependencies in Nexmark benchmark suite.
(#36513)
add 8bd92b5e376 Fix the soft-delete check and emit soft-delete log warning
at most once per bucket. (#36585)
add afeca4ea301 Increase timeouts (#36595)
add 66b7c7476ce Make SpannerChangeStreamPlacementTableIT against Spanner
prod. (#36071)
add fdfa6ec6338 Exclude a perma-red test suite
beam_PostCommit_XVR_GoUsingJava_Dataflow.yml (#36597)
add 6dedf8f0bab Update REVIEWERS.yml (#36598)
add fe71ab1b47b Add ordered window elements into example folder (#36575)
add ef07e40667b Fix proposal link (#36600)
add f2860fa2fe8 use utils._convert_to_result for huggingface_inference
(#36593)
add 05f6f01a33b Force torch to use cpu wheels (#36583)
add 6df5bd04185 Switch to use gcp-io expansion service for YAML BQIO
(#36604)
add a846bc92950 Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks
(#36611)
add 1a4298f209c Bump github.com/avast/retry-go/v4 from 4.6.1 to 4.7.0 in
/sdks (#36519)
add a3d42aec4e0 Update woodstox package and version (#36613)
add 518b118bcaf Fix vLLM Gemma, add vLLM extra, fix getting throughput
(#36451)
add 7bfe0e19974 Do not panic if an element has no windows during
PersistBundle. (#36610)
add 64a92b2806d [python] Move histogram metric from internal to public
interface/files (#36405)
add 92a40213231 Force logback version in transitive dependencies
add f517b01c502 Merge pull request #36594: Force logback version in
transitive dependencies
add 85853a3edf0 proto change
add a6d2b7dabf5 add draining to output builder, encode draining
add 951943e9bba add draining to output builder
add 7ea3109a0e4 default impls
add 3d9e403b3ed comment
add 499039fe37d remove nullable
add cca50bff5aa remove nullable
add f8037f0f5bf remove nullable
add ac99abf3d79 rename field
add fc4b29c4256 rename field
add 2bd497f5d55 Merge pull request #36524: Drain - model part +
windowedValue changes
add 4e0dbb9f452 Upgrade joda-time to 2.14.0 (#36626)
add c6d92079b48 fix test (#36632)
add 9612583296a Bump github.com/linkedin/goavro/v2 from 2.14.0 to 2.14.1
in /sdks (#36628)
add 80f4564fbdc Bump github.com/nats-io/nats-server/v2 from 2.12.0 to
2.12.1 in /sdks (#36520)
add 471050c7cde add licences manually (#36635)
add 0f6b605f9e5 Fix a bug in streaming OrderedWindowElements. (#36642)
add 0c10658e9ba [Dataflow Streaming] Intern encoded tags across keys
(#36313)
add 949c87f0e20 Cache IntervalWindow hashCode (#36612)
add ecc840cd1e7 [Java SDK] Fix propagation of metrics set during onTimer
processing. (#36576)
add 942de54a14c Adding release-2.69.0-postrelease to protected branches in
.asf.yaml
add 00516e97235 Update managed-io.md for release 2.69.0-RC2.
add 3deba11b8a2 Merge pull request #36569 from
apache/updates_managed_io_docs_2.69.0_rc2
add bcf41e14aba Add missing py313 ML container requirements file (#36647)
add be7acf5eca2 Update Beam website to release 2.69.0
add be47decb542 Update date
add 37ca7d54090 Update breaking changes
add fdc89112719 Merge pull request #36554 from apache/release-269-website
add 5a8e2dc3996 remove empty file (#36648)
add 5fe0d4c084b Add batch version of OrderedWindowElements in examples
(#36621)
add 3432480129c Update website for roadmap and version compatibility
(#36602)
add 21dbf592f87 Adds Multimap support to JAVA FnApi (#36218)
add c60b8ae8671 Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#36644)
add b33ab6e2e94 Bump cloud.google.com/go/bigquery from 1.70.0 to 1.71.0 in
/sdks (#36500)
add b2960c9db3e fix(website): Use standard method for CSP frame-src
exceptions (#36653)
add 020335ee23b Fixed KafkaIO Python perf test: use existing kafka-cluster
config, fix broker setup, and correct test arguments
add 50477d8bd9b ix KafkaIO perf test assertion logic
add b9ec235e5ec fixed linting
add 54e4dcf737f Fixed the pylint error
add f5416c2bcc7 Fixed the YAPF formatting issue
add 8b2657bf80d fixed kafka stress tests
add 263510afbfd Fix Kafka stress test: remove invalid param
add ab4a80ddd22 fixed formatting
add f8c8dda8ed4 removed invalid params
add 0e4ac08e4b1 Merge pull request #36633 from
aIbrahiim/30960-performance-tests-xlang-kafka--python
add 1b34a6d7571 Bump go.mongodb.org/mongo-driver from 1.17.4 to 1.17.6 in
/sdks (#36659)
add 86bc45286d1 fixed issue in python precommit (#36561)
add 0697e54a543 Kerberos Authentication for KafkaIO (#36099)
add 1c5f0f3a505 Revert "Force logback version in transitive dependencies"
(#36649)
add 55880d361a5 Split ViewTest (#36655)
add 190f21e6e5e Ensure consistent behavior between streaming and batch
order window elements (#36661)
add 69685250777 Bump cloud.google.com/go/spanner from 1.86.0 to 1.86.1 in
/sdks (#36645)
add 74576946753 Bump cloud.google.com/go/bigtable from 1.39.0 to 1.40.1 in
/sdks (#36448)
add 8481373fed5 Fix typo in release notes (#36651)
add 8c626494d3a Bump cloud.google.com/go/datastore from 1.20.0 to 1.21.0
in /sdks (#36627)
add b976b515c4e Change ExecutionStateSampler.ExecutionState to support a
scopedActivate method. From benchmarks this is no additional overhead and it is
easier to use. (#36646)
add 0fd63981f10 Bump cloud.google.com/go/storage from 1.57.0 to 1.57.1 in
/sdks (#36673)
add 42e01c2bd24 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#36674)
add 658b8f6dade Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#36676)
add 47e3088f1c5 Revert "fix(website): Use standard method for CSP
frame-src exceptions (#36653)" (#36679)
add 00904948baf Configure GCR auth (#36678)
add 2761883d749 Pin logback 1.5.20 in io-expansion-service (#36669)
add fe07fe76709 Fix test expectations which appear to fail with
differences in generated proto classes (#36680)
add 1e51a886f5c Free disk space for snapshot job and use correct
requirements file (#36681)
add 79229c1e0fa Update Beam version for republish released docker
containers workflow
add 8295cfb28fe Merge pull request #36664 from apache/update-republish
add 6b4dc555a24 Add spannerio vector writer. (#36654)
add 01e1cf6893e [Prism] Fix data race while accesing processing time queue
(#36672)
add 330ba8b14c1 Bump actions/setup-node from 5 to 6 (#36589)
add 158e55bd75a Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#36691)
add eba04b2a567 Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#36693)
add d90b4e83017 Use vLLM extra to generate GPU requirements files (#36420)
add d46a0135966 Merge pull request #36425 from
reuvenlax/fix_reverse_f_issue
add 26bf1b899dc Update beam-master images for python sdks (#36699)
add 735864d4d5c Update Python Dependencies (#36701)
add 8e0a449aad2 Use JDK 21 and Go 1.25 for Playground CI (#36700)
add 840462b109a Fix PreCommit Java IO Direct Job (#36696)
add f774df0e6af Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#36706)
add 093084a015a Install yaml extra when running yaml tests (#36707)
add 40e2b0d01f2 Only log Kafka commit failures as warning every 10m and if
failing for > 10m. (#36685)
add 3a1ae18a8d4 Split some dependencies out of main beam package into
existing extras (#36697)
add 1f63118d993 Fix warning message (#36703)
add 89947fded65 fix jsonToRowTest race condition (#36616)
add 6327aab91c5 Multimap streaming (#36714)
add 99a0979c473 Bump github.com/aws/smithy-go from 1.23.1 to 1.23.2 in
/sdks (#36715)
add a57872f6946 Fix Docker authentication for Python ValidatesContainer
Dataflow With RC tests (#36718)
add ca57641c519 Bump cloud.google.com/go/bigquery from 1.71.0 to 1.72.0 in
/sdks (#36675)
add 4455616511e feat(io-gcp-bigquery): Add log for direct read quota
exceeded retries (#36717)
add 269706a585c Async Post Load Test Fixes (#36596)
add 6a5923338a1 Add yaml when generating requirements (#36711)
add 107a558a2c9 Support portable decimal types for Beam SQL (#36713)
add b025102b024 When more than one instance of the same PipelineOption
subclass is detected, use the first one. (#36704)
add 6d24c3dec3b [Prism] Fix a distribution metric problem when count is
zero (#36723)
add 1e40f0663e2 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#36724)
add 0448a5b8062 Bump google.golang.org/api from 0.252.0 to 0.255.0 in
/sdks (#36726)
add 2d617c04bc8 Remove Python 3.9 support from Apache Beam (#36665)
add 9ec41f89932 fix pip intall command (#36734)
add 11f9b0ce909 Extract expiring memoizing supplier as a separate utility
and run end offset refreshes in the current thread. (#36075)
add c2e72ac2dab Streaming read for BigQuery (#36668)
add ff1d6bb62fe feat(typehints): add Python 3.12 TypeAliasType support
(#36709)
add d1327b774cb update beam master tag (#36733)
add bf19899d221 Add timestamp logicaltype (#36705)
add 1d33741c035 Fix Flink IllegalThreadStateException on Java 8 (#36730)
add 09f4963e959 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#36740)
add 83673d84ff1 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#36741)
add b6b65097347 Clean up setup.py to remove old version restrictions
(#36731)
add a70f1f3c0e5 Bump github.com/docker/docker in /sdks (#36739)
add 569147226c1 Bump transformers
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (27dd8e7a1bc)
\
N -- N -- N
refs/heads/dependabot/pip/sdks/python/apache_beam/examples/inference/large_language_modeling/transformers-4.53.0
(569147226c1)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 2 +
.github/REVIEWERS.yml | 2 -
.../test-properties.json | 18 +-
.../actions/setup-environment-action/action.yml | 12 +-
.../arc/images/Dockerfile | 4 +-
.../IO_Iceberg_Integration_Tests.json | 2 +-
...aming.json => beam_PostCommit_Go_VR_Spark.json} | 2 +-
.github/trigger_files/beam_PostCommit_Java.json | 2 +-
.../beam_PostCommit_Java_DataflowV1.json | 2 +-
.../beam_PostCommit_Java_DataflowV2.json | 2 +-
.../beam_PostCommit_Java_PVR_Spark3_Streaming.json | 2 +-
.github/trigger_files/beam_PostCommit_Python.json | 2 +-
.../beam_PostCommit_Python_Dependency.json | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Direct.json | 2 +-
...m_PostCommit_XVR_JavaUsingPython_Dataflow.json} | 2 +-
...m_PostCommit_XVR_PythonUsingJava_Dataflow.json} | 0
.../trigger_files/beam_PostCommit_XVR_Samza.json | 2 +-
...ow_ARM.json => beam_PostCommit_XVR_Spark3.json} | 0
...tainer.json => beam_PreCommit_Python_Dill.json} | 2 +-
.../workflows/beam_CloudML_Benchmarks_Dataflow.yml | 4 +-
.../beam_LoadTests_Python_CoGBK_Dataflow_Batch.yml | 8 +-
...m_LoadTests_Python_CoGBK_Dataflow_Streaming.yml | 8 +-
.../beam_LoadTests_Python_CoGBK_Flink_Batch.yml | 17 +-
...eam_LoadTests_Python_Combine_Dataflow_Batch.yml | 6 +-
...LoadTests_Python_Combine_Dataflow_Streaming.yml | 6 +-
.../beam_LoadTests_Python_Combine_Flink_Batch.yml | 6 +-
...am_LoadTests_Python_Combine_Flink_Streaming.yml | 4 +-
...LoadTests_Python_FnApiRunner_Microbenchmark.yml | 2 +-
.../beam_LoadTests_Python_GBK_Dataflow_Batch.yml | 10 +-
...eam_LoadTests_Python_GBK_Dataflow_Streaming.yml | 2 +-
...adTests_Python_GBK_reiterate_Dataflow_Batch.yml | 4 +-
...sts_Python_GBK_reiterate_Dataflow_Streaming.yml | 4 +-
.../beam_LoadTests_Python_ParDo_Dataflow_Batch.yml | 8 +-
...m_LoadTests_Python_ParDo_Dataflow_Streaming.yml | 8 +-
.../beam_LoadTests_Python_ParDo_Flink_Batch.yml | 6 +-
...beam_LoadTests_Python_ParDo_Flink_Streaming.yml | 10 +-
...m_LoadTests_Python_SideInput_Dataflow_Batch.yml | 20 +-
.github/workflows/beam_LoadTests_Python_Smoke.yml | 4 +-
...eam_PerformanceTests_BiqQueryIO_Read_Python.yml | 2 +-
...formanceTests_BiqQueryIO_Write_Python_Batch.yml | 2 +-
...erformanceTests_PubsubIOIT_Python_Streaming.yml | 2 +-
..._PerformanceTests_SpannerIO_Read_2GB_Python.yml | 2 +-
...manceTests_SpannerIO_Write_2GB_Python_Batch.yml | 2 +-
.../beam_PerformanceTests_TextIOIT_Python.yml | 2 +-
...PerformanceTests_WordCountIT_PythonVersions.yml | 2 +-
.../beam_PerformanceTests_xlang_KafkaIO_Python.yml | 84 +-
.github/workflows/beam_Playground_CI_Nightly.yml | 7 +-
.github/workflows/beam_Playground_Precommit.yml | 2 +-
.../beam_PostCommit_PortableJar_Flink.yml | 4 +-
.../beam_PostCommit_PortableJar_Spark.yml | 4 +-
.github/workflows/beam_PostCommit_Python.yml | 2 +-
.github/workflows/beam_PostCommit_Python_Arm.yml | 13 +-
.../beam_PostCommit_Python_Dependency.yml | 4 +-
.../beam_PostCommit_Python_Examples_Direct.yml | 2 +-
.../beam_PostCommit_Python_Examples_Flink.yml | 2 +-
.../beam_PostCommit_Python_Examples_Spark.yml | 2 +-
.../beam_PostCommit_Python_Nexmark_Direct.yml | 2 +-
.../beam_PostCommit_Python_Portable_Flink.yml | 6 +-
...stCommit_Python_ValidatesContainer_Dataflow.yml | 19 +-
..._Python_ValidatesContainer_Dataflow_With_RC.yml | 9 +-
..._PostCommit_Python_ValidatesRunner_Dataflow.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Flink.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Samza.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Spark.yml | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Dataflow.yml | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Direct.yml | 2 +-
.../beam_PostCommit_Python_Xlang_IO_Dataflow.yml | 2 +-
.../beam_PostCommit_Python_Xlang_IO_Direct.yml | 2 +-
.../beam_PostCommit_TransformService_Direct.yml | 4 +-
.github/workflows/beam_PostCommit_XVR_Direct.yml | 4 +-
.github/workflows/beam_PostCommit_XVR_Flink.yml | 4 +-
.../beam_PostCommit_XVR_GoUsingJava_Dataflow.yml | 6 +-
...eam_PostCommit_XVR_JavaUsingPython_Dataflow.yml | 4 +-
...eam_PostCommit_XVR_PythonUsingJava_Dataflow.yml | 4 +-
.github/workflows/beam_PostCommit_XVR_Samza.yml | 4 +-
.github/workflows/beam_PostCommit_XVR_Spark3.yml | 4 +-
.../beam_PostCommit_Yaml_Xlang_Direct.yml | 2 +-
.../workflows/beam_PreCommit_Flink_Container.yml | 4 +-
.../workflows/beam_PreCommit_Java_IOs_Direct.yml | 2 +
.../workflows/beam_PreCommit_Portable_Python.yml | 4 +-
.github/workflows/beam_PreCommit_Prism_Python.yml | 4 +-
.github/workflows/beam_PreCommit_Python.yml | 2 +-
.github/workflows/beam_PreCommit_PythonDocker.yml | 2 +-
.../workflows/beam_PreCommit_Python_Coverage.yml | 4 +-
.../workflows/beam_PreCommit_Python_Dataframes.yml | 2 +-
.github/workflows/beam_PreCommit_Python_Dill.yml | 6 +-
.../workflows/beam_PreCommit_Python_Examples.yml | 2 +-
.../beam_PreCommit_Python_Integration.yml | 2 +-
.github/workflows/beam_PreCommit_Python_ML.yml | 18 +-
.../workflows/beam_PreCommit_Python_Runners.yml | 2 +-
.../workflows/beam_PreCommit_Python_Transforms.yml | 2 +-
.../beam_PreCommit_Xlang_Generated_Transforms.yml | 2 +-
.../workflows/beam_PreCommit_Yaml_Xlang_Direct.yml | 4 +-
.../workflows/beam_Publish_Beam_SDK_Snapshots.yml | 8 +-
.../workflows/beam_Publish_Docker_Snapshots.yml | 2 +-
...beam_Python_ValidatesContainer_Dataflow_ARM.yml | 2 +-
.../workflows/beam_StressTests_Java_KafkaIO.yml | 77 +-
.github/workflows/build_release_candidate.yml | 51 +-
.github/workflows/build_wheels.yml | 8 +-
.github/workflows/code_completion_plugin_tests.yml | 2 +-
.github/workflows/dask_runner_tests.yml | 3 +-
...Sentiment_Streaming_DistilBert_Base_Uncased.txt | 3 +-
...Python_Benchmarks_Dataflow_VLLM_Gemma_Batch.txt | 4 +-
..._CoGBK_Dataflow_Flink_Batch_100b_Single_Key.txt | 28 -
.../python_CoGBK_Dataflow_Flink_Batch_10kB.txt | 28 -
...ython_CoGBK_Flink_Batch_100b_Multiple_Keys.txt} | 10 +-
...> python_CoGBK_Flink_Batch_100b_Single_Key.txt} | 19 +-
...out_1.txt => python_CoGBK_Flink_Batch_10kB.txt} | 19 +-
...hon_Combine_Flink_Batch_2GB_10_byte_records.txt | 2 +-
.../python_Combine_Flink_Batch_2GB_Fanout_4.txt | 2 +-
.../python_Combine_Flink_Batch_2GB_Fanout_8.txt | 2 +-
...Combine_Flink_Streaming_2GB_10_byte_records.txt | 2 +-
...python_Combine_Flink_Streaming_2GB_Fanout_4.txt | 2 +-
...python_Combine_Flink_Streaming_2GB_Fanout_8.txt | 2 +-
...thon_Combine_Flink_Streaming_small_Fanout_1.txt | 2 +-
...thon_Combine_Flink_Streaming_small_Fanout_2.txt | 2 +-
.../python_GBK_Flink_Batch_2GB_of_100B_records.txt | 2 +-
.../python_GBK_Flink_Batch_2GB_of_10B_records.txt | 2 +-
...nout_4_times_with_2GB_10-byte_records_total.txt | 2 +-
...nout_8_times_with_2GB_10-byte_records_total.txt | 2 +-
...K_Flink_Batch_reiterate_4_times_10kB_values.txt | 2 +-
.../python_ParDo_Flink_Batch_10_Counters.txt | 2 +-
.../python_ParDo_Flink_Batch_10_Iterations.txt | 2 +-
.../python_ParDo_Flink_Batch_200_Iterations.txt | 2 +-
.../python_ParDo_Flink_Streaming_100_Counters.txt | 2 +-
.../python_ParDo_Flink_Streaming_10_Counters.txt | 2 +-
.../python_ParDo_Flink_Streaming_10_Iterations.txt | 2 +-
...python_ParDo_Flink_Streaming_200_Iterations.txt | 2 +-
.../python_ParDo_Flink_Streaming_5_Iterations.txt | 2 +-
.github/workflows/pr-bot-new-prs.yml | 2 +-
.github/workflows/pr-bot-pr-updates.yml | 2 +-
.github/workflows/pr-bot-prs-needing-attention.yml | 2 +-
.github/workflows/python_dependency_tests.yml | 1 -
.github/workflows/python_tests.yml | 3 +-
.github/workflows/refresh_looker_metrics.yml | 6 -
.github/workflows/reportGenerator.yml | 2 +-
.../republish_released_docker_containers.yml | 23 +-
.github/workflows/run_perf_alert_tool.yml | 2 +-
.../run_rc_validation_python_mobile_gaming.yml | 2 +-
.../workflows/run_rc_validation_python_yaml.yml | 10 +-
.github/workflows/typescript_tests.yml | 10 +-
.github/workflows/update_python_dependencies.yml | 4 +-
.pre-commit-config.yaml | 2 +-
.test-infra/jenkins/PythonTestProperties.groovy | 12 +-
.test-infra/jenkins/build.gradle | 4 +-
.test-infra/jenkins/metrics_report/tox.ini | 6 +-
.../kafka-cluster/03-zookeeper/50pzoo.yml | 121 +-
.../kubernetes/kafka-cluster/05-kafka/50kafka.yml | 156 +-
.test-infra/metrics/influxdb/Dockerfile | 2 +-
.test-infra/metrics/influxdb/gsutil/Dockerfile | 2 +-
.test-infra/metrics/sync/github/Dockerfile | 2 +-
.test-infra/metrics/sync/jenkins/Dockerfile | 2 +-
.test-infra/mock-apis/go.mod | 4 +-
.test-infra/mock-apis/poetry.lock | 6 +-
.test-infra/mock-apis/pyproject.toml | 2 +-
.test-infra/tools/python_installer.sh | 2 +-
CHANGES.md | 80 +-
build.gradle.kts | 30 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 14 +-
contributor-docs/code-change-guide.md | 2 +-
contributor-docs/python-tips.md | 30 +-
contributor-docs/release-guide.md | 2 +-
dev-support/docker/Dockerfile | 2 +-
dev-support/docker/pkglist | 7 +-
...nadoes.java => BigQueryStreamingTornadoes.java} | 93 +-
.../beam-ml/milvus_enrichment_transform.ipynb | 2657 ++++++++++++++++++++
gradle.properties | 6 +-
infra/enforcement/iam.py | 4 +
infra/iam/README.md | 1 +
infra/iam/users.tf | 3 +-
infra/iam/users.yml | 198 +-
.../java/org/apache/beam/it/kafka/KafkaIOST.java | 28 +-
local-env-setup.sh | 4 +-
.../beam/model/fn_execution/v1/beam_fn_api.proto | 34 +-
.../beam/model/pipeline/v1/beam_runner_api.proto | 10 +-
.../apache/beam/model/pipeline/v1/metrics.proto | 10 +-
playground/backend/containers/go/Dockerfile | 2 +-
playground/backend/containers/go/build.gradle | 2 +-
.../cloudbuild/playground_cd_examples.sh | 8 +-
.../cloudbuild/playground_ci_examples.sh | 10 +-
release/src/main/Dockerfile | 3 +-
.../python-release/python_release_automation.sh | 2 +-
release/src/main/scripts/set_version.sh | 3 +
...TimeBoundedSplittableProcessElementInvoker.java | 35 +-
.../apache/beam/runners/core/SimpleDoFnRunner.java | 130 -
.../core/SplittableParDoViaKeyedWorkItems.java | 21 -
runners/flink/job-server/flink_job_server.gradle | 1 +
.../flink/FlinkPipelineExecutionEnvironment.java | 43 +
runners/google-cloud-dataflow-java/build.gradle | 1 +
.../beam/runners/dataflow/BatchViewOverrides.java | 5 +
.../beam/runners/dataflow/DataflowRunner.java | 50 +-
.../dataflow/RedistributeByKeyOverrideFactory.java | 1 +
.../beam/runners/dataflow/DataflowRunnerTest.java | 80 +-
.../dataflow/worker/StreamingDataflowWorker.java | 5 +
.../worker/StreamingModeExecutionContext.java | 4 +
.../dataflow/worker/UngroupedWindmillReader.java | 5 +
.../dataflow/worker/WindmillKeyedWorkItem.java | 5 +-
.../dataflow/worker/WindmillNamespacePrefix.java | 10 +-
.../beam/runners/dataflow/worker/WindmillSink.java | 46 +-
.../dataflow/worker/WindmillTimerInternals.java | 49 +-
.../harness/StreamingWorkerStatusReporter.java | 2 +-
.../dataflow/worker/util/ValueInEmptyWindows.java | 5 +
.../util/common/worker/InternedByteString.java | 77 +
.../windmill/client/grpc/GrpcGetDataStream.java | 39 +-
.../client/grpc/GrpcGetDataStreamRequests.java | 211 +-
.../worker/windmill/state/CachingStateTable.java | 130 +-
.../worker/windmill/state/WindmillBag.java | 18 +-
.../windmill/state/WindmillCombiningState.java | 24 +-
.../worker/windmill/state/WindmillMap.java | 29 +-
.../worker/windmill/state/WindmillMultimap.java | 23 +-
.../worker/windmill/state/WindmillOrderedList.java | 16 +-
.../worker/windmill/state/WindmillStateCache.java | 82 +-
.../windmill/state/WindmillStateInternals.java | 4 +-
...illStateUtil.java => WindmillStateTagUtil.java} | 65 +-
.../worker/windmill/state/WindmillValue.java | 20 +-
.../windmill/state/WindmillWatermarkHold.java | 29 +-
.../worker/StreamingGroupAlsoByWindowFnsTest.java | 8 +-
...reamingGroupAlsoByWindowsReshuffleDoFnTest.java | 8 +-
.../dataflow/worker/WindmillKeyedWorkItemTest.java | 9 +-
.../util/common/worker/InternedByteStringTest.java | 68 +
.../client/grpc/GrpcGetDataStreamRequestsTest.java | 160 +-
.../client/grpc/GrpcGetDataStreamTest.java | 51 +
.../windmill/state/WindmillStateCacheTest.java | 232 +-
.../windmill/state/WindmillStateInternalsTest.java | 3 +
...UtilTest.java => WindmillStateTagUtilTest.java} | 16 +-
runners/prism/java/build.gradle | 2 +-
runners/samza/job-server/build.gradle | 1 +
runners/spark/job-server/spark_job_server.gradle | 1 +
.../apache/beam/runners/spark/util/TimerUtils.java | 5 +
scripts/beam-sql.sh | 448 ++++
sdks/go.mod | 97 +-
sdks/go.sum | 190 +-
sdks/go/cmd/prism/prism.go | 50 +-
sdks/go/pkg/beam/core/core.go | 2 +-
sdks/go/pkg/beam/core/runtime/harness/harness.go | 2 +-
.../core/runtime/xlangx/expansionx/download.go | 20 +
sdks/go/pkg/beam/forward.go | 5 +
sdks/go/pkg/beam/log/log.go | 61 +-
.../go/pkg/beam/log/{standard.go => structural.go} | 26 +-
sdks/go/pkg/beam/runners/prism/internal/coders.go | 6 +-
.../prism/internal/engine/elementmanager.go | 59 +-
.../runners/prism/internal/engine/teststream.go | 9 +-
sdks/go/pkg/beam/runners/prism/internal/execute.go | 81 +-
.../beam/runners/prism/internal/handlerunner.go | 109 +
.../runners/prism/internal/jobservices/metrics.go | 6 +
sdks/go/pkg/beam/runners/prism/internal/stage.go | 5 +-
.../runners/prism/internal/unimplemented_test.go | 3 +
.../beam/runners/prism/internal/worker/worker.go | 8 +-
.../go/pkg/beam/runners/universal/runnerlib/job.go | 12 +-
sdks/go/pkg/beam/runners/universal/universal.go | 3 +-
sdks/go/pkg/beam/x/debug/print_test.go | 9 +-
sdks/go/run_with_go_version.sh | 2 +-
sdks/go/test/integration/integration.go | 6 +-
sdks/go/test/integration/primitives/timers.go | 36 +-
sdks/go/test/integration/primitives/timers_test.go | 5 +
.../resources/beam/checkstyle/suppressions.xml | 1 +
.../beam/sdk/fn/stream/PrefetchableIterables.java | 2 +-
.../apache/beam/sdk/options/PipelineOptions.java | 11 +-
.../apache/beam/sdk/schemas/AutoValueSchema.java | 2 +-
.../beam/sdk/schemas/logicaltypes/Timestamp.java | 166 ++
.../transforms/providers/ErrorHandling.java | 2 +
.../beam/sdk/schemas/utils/AutoValueUtils.java | 101 +-
.../org/apache/beam/sdk/transforms/Combine.java | 19 +
.../java/org/apache/beam/sdk/transforms/DoFn.java | 31 -
.../org/apache/beam/sdk/transforms/DoFnTester.java | 64 -
.../beam/sdk/transforms/GroupByEncryptedKey.java | 40 +-
.../apache/beam/sdk/transforms/Redistribute.java | 1 +
.../java/org/apache/beam/sdk/transforms/Reify.java | 1 +
.../org/apache/beam/sdk/transforms/Reshuffle.java | 1 +
.../sdk/transforms/windowing/IntervalWindow.java | 17 +-
.../beam/sdk/transforms/windowing/PaneInfo.java | 58 +-
.../ExpiringMemoizingSerializableSupplier.java | 101 +
.../org/apache/beam/sdk/util/RowJsonUtils.java | 31 +-
.../sdk/util/construction/CombineTranslation.java | 17 +-
.../beam/sdk/util/construction/Environments.java | 26 +
.../beam/sdk/util/construction/External.java | 2 +-
.../construction/SplittableParDoNaiveBounded.java | 48 -
.../org/apache/beam/sdk/values/OutputBuilder.java | 2 +
.../org/apache/beam/sdk/values/TypeDescriptor.java | 5 +
.../beam/sdk/values/ValueInSingleWindow.java | 21 +-
.../org/apache/beam/sdk/values/WindowedValue.java | 2 +
.../org/apache/beam/sdk/values/WindowedValues.java | 171 +-
.../sdk/schemas/logicaltypes/LogicalTypesTest.java | 267 ++
.../beam/sdk/schemas/utils/AutoValueUtilsTest.java | 166 ++
.../sdk/transforms/GroupByEncryptedKeyTest.java | 16 +-
.../apache/beam/sdk/transforms/GroupByKeyIT.java | 47 +-
.../apache/beam/sdk/transforms/GroupByKeyTest.java | 104 +-
.../transforms/{ViewTest.java => MapViewTest.java} | 884 +------
.../org/apache/beam/sdk/transforms/ParDoTest.java | 67 +
.../org/apache/beam/sdk/transforms/ViewTest.java | 951 -------
.../sdk/transforms/windowing/PaneInfoTest.java | 20 +
.../ExpiringMemoizingSerializableSupplierTest.java | 166 ++
.../apache/beam/sdk/util/WindowedValueTest.java | 30 +
.../sdk/util/construction/EnvironmentsTest.java | 3 +
.../util/construction/ValidateRunnerXlangTest.java | 129 +
sdks/java/expansion-service/container/Dockerfile | 1 -
.../container/expansion_service_config.yml | 30 +-
.../sdk/expansion/service/ExpansionService.java | 14 +
.../expansion/service/ExpansionServiceOptions.java | 7 +
.../sdk/expansion/service/TransformProvider.java | 55 +-
...xpansionServiceSchemaTransformProviderTest.java | 90 +-
.../expansion/service/ExpansionServiceTest.java | 2 +-
.../resources/test_expansion_service_config.yaml | 3 +
.../extensions/gcp/auth/GcpCredentialFactory.java | 5 +
sdks/java/extensions/kafka-factories/build.gradle | 46 +
.../kafka/factories/FileAwareFactoryFn.java | 258 ++
.../kafka/factories/KerberosConsumerFactoryFn.java | 150 ++
.../extensions/kafka/factories}/package-info.java | 4 +-
.../kafka/factories/FileAwareFactoryFnTest.java | 268 ++
.../factories/KerberosConsumerFactoryFnTest.java | 242 ++
.../src/test/proto/proto3_schema_messages.proto | 47 +-
.../python/PythonExternalTransformTest.java | 62 +-
.../schemaio-expansion-service/build.gradle | 6 +
.../sdk/extensions/sql/impl/JavaUdfLoader.java | 14 +
.../sdk/extensions/sql/impl/rel/BeamCalcRel.java | 5 +
.../control/ExecutionStateSamplerBenchmark.java | 17 +
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 171 +-
.../fn/harness/control/ExecutionStateSampler.java | 19 +
.../fn/harness/control/ProcessBundleHandler.java | 11 +-
.../harness/data/PCollectionConsumerRegistry.java | 89 +-
.../harness/data/PTransformFunctionRegistry.java | 5 +-
.../beam/fn/harness/state/FnApiStateAccessor.java | 121 +-
.../beam/fn/harness/state/MultimapUserState.java | 139 +-
.../harness/control/ExecutionStateSamplerTest.java | 140 +-
.../harness/control/ProcessBundleHandlerTest.java | 134 +
.../harness/logging/BeamFnLoggingClientTest.java | 6 +-
.../fn/harness/state/MultimapUserStateTest.java | 129 +
sdks/java/io/expansion-service/build.gradle | 5 +
sdks/java/io/google-cloud-platform/build.gradle | 3 +
.../beam/sdk/io/gcp/bigquery/AppendClientInfo.java | 13 +
.../beam/sdk/io/gcp/bigquery/BatchLoads.java | 7 +-
.../bigquery/BigQueryDynamicReadDescriptor.java | 101 +
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 341 ++-
.../sdk/io/gcp/bigquery/BigQueryIOTranslation.java | 5 +-
.../sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 1 +
.../gcp/bigquery/BigQueryStorageStreamSource.java | 21 +
.../beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 47 +-
.../beam/sdk/io/gcp/bigquery/RowWriterFactory.java | 20 +-
.../sdk/io/gcp/bigquery/SplittingIterable.java | 19 +-
.../StorageApiDynamicDestinationsBeamRow.java | 13 +-
...StorageApiDynamicDestinationsGenericRecord.java | 7 +-
.../StorageApiDynamicDestinationsProto.java | 19 +-
.../StorageApiDynamicDestinationsTableRow.java | 15 +-
.../bigquery/StorageApiWriteUnshardedRecords.java | 21 +-
.../bigquery/StorageApiWritesShardedRecords.java | 4 +-
.../io/gcp/bigquery/TableRowToStorageApiProto.java | 1057 ++++++--
.../changestreams/dao/PartitionMetadataDao.java | 16 +-
.../sdk/io/gcp/testing/FakeDatasetService.java | 7 +
...eQueryIT.java => BigQueryIODynamicQueryIT.java} | 55 +-
...geQueryIT.java => BigQueryIODynamicReadIT.java} | 99 +-
...T.java => BigQueryIODynamicReadTableRowIT.java} | 27 +-
.../io/gcp/bigquery/BigQueryIODynamicReadTest.java | 786 ++++++
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 546 +++-
.../gcp/bigquery/TableRowToStorageApiProtoIT.java | 170 ++
.../bigquery/TableRowToStorageApiProtoTest.java | 561 ++++-
.../dao/PartitionMetadataDaoTest.java | 33 +-
.../it/SpannerChangeStreamPlacementTableIT.java | 16 +-
.../apache/beam/sdk/io/iceberg/RecordWriter.java | 10 +-
.../ReadFromPostgresSchemaTransformProvider.java | 10 +-
.../WriteToPostgresSchemaTransformProvider.java | 10 +-
.../java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 40 +-
.../KafkaReadSchemaTransformConfiguration.java | 18 +
.../beam/sdk/io/kafka/KafkaSourceDescriptor.java | 8 +
.../beam/sdk/io/kafka/KafkaUnboundedReader.java | 22 +-
.../kafka/KafkaWriteSchemaTransformProvider.java | 9 +
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 104 +-
.../org/apache/beam/sdk/io/kafka/KafkaIOTest.java | 59 +
.../KafkaReadSchemaTransformProviderTest.java | 112 +
.../KafkaWriteSchemaTransformProviderTest.java | 66 +
sdks/java/io/xml/build.gradle | 4 +-
.../java/org/apache/beam/sdk/io/xml/JAXBCoder.java | 28 +-
sdks/python/.isort.cfg | 58 +
sdks/python/.pylintrc | 15 +-
sdks/python/apache_beam/__init__.py | 5 +-
sdks/python/apache_beam/coders/coder_impl.py | 6 +-
sdks/python/apache_beam/coders/coders.py | 17 +-
.../coders/coders_property_based_test.py | 2 +-
sdks/python/apache_beam/coders/coders_test.py | 2 +-
.../apache_beam/coders/coders_test_common.py | 3 +-
sdks/python/apache_beam/dataframe/expressions.py | 3 +-
sdks/python/apache_beam/dataframe/io.py | 1 +
.../cookbook/ordered_window_elements}/__init__.py | 0
.../cookbook/ordered_window_elements/batch.py | 522 ++++
.../cookbook/ordered_window_elements/batch_test.py | 333 +++
.../cookbook/ordered_window_elements/streaming.py | 638 +++++
.../ordered_window_elements/streaming_test.py | 397 +++
...lassification.py => gemini_image_generation.py} | 49 +-
.../inference/gemini_text_classification.py | 12 +-
.../snippets/transforms/elementwise/enrichment.py | 77 +-
.../transforms/elementwise/enrichment_test.py | 171 +-
.../internal/cloudpickle/cloudpickle.py | 79 +-
.../apache_beam/internal/cloudpickle_pickler.py | 85 +-
.../apache_beam/internal/code_object_pickler.py | 90 +-
.../internal/code_object_pickler_test.py | 27 +-
sdks/python/apache_beam/internal/dill_pickler.py | 42 +-
sdks/python/apache_beam/internal/gcp/auth.py | 2 +-
sdks/python/apache_beam/internal/metrics/cells.py | 165 --
.../apache_beam/internal/metrics/cells_test.py | 77 -
sdks/python/apache_beam/internal/metrics/metric.py | 44 -
.../apache_beam/internal/metrics/metric_test.py | 130 -
sdks/python/apache_beam/internal/module_test.py | 7 +
sdks/python/apache_beam/internal/pickler.py | 19 +-
sdks/python/apache_beam/internal/pickler_test.py | 44 +
sdks/python/apache_beam/io/__init__.py | 1 +
.../io/azure/blobstoragefilesystem_test.py | 2 +-
sdks/python/apache_beam/io/azure/blobstorageio.py | 6 +-
.../io/external/xlang_jdbcio_it_test.py | 2 +-
.../io/external/xlang_kafkaio_perf_test.py | 10 +-
sdks/python/apache_beam/io/filebasedsink.py | 14 +
sdks/python/apache_beam/io/filebasedsource.py | 4 +-
sdks/python/apache_beam/io/filebasedsource_test.py | 2 +-
sdks/python/apache_beam/io/filesystem_test.py | 1 +
sdks/python/apache_beam/io/gcp/__init__.py | 1 +
sdks/python/apache_beam/io/gcp/bigquery.py | 53 +-
.../apache_beam/io/gcp/bigquery_file_loads_test.py | 30 +-
.../io/gcp/bigquery_geography_it_test.py | 544 ++++
.../apache_beam/io/gcp/bigquery_schema_tools.py | 3 +-
.../io/gcp/bigquery_schema_tools_test.py | 134 +-
sdks/python/apache_beam/io/gcp/bigquery_test.py | 13 +-
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 17 +-
.../apache_beam/io/gcp/bigquery_tools_test.py | 160 +-
sdks/python/apache_beam/io/gcp/bigtableio.py | 3 +-
.../apache_beam/io/gcp/bigtableio_it_test.py | 4 +-
sdks/python/apache_beam/io/gcp/bigtableio_test.py | 9 +-
.../io/gcp/datastore/v1new/datastoreio.py | 3 +-
.../io/gcp/datastore/v1new/query_splitter_test.py | 3 +-
.../io/gcp/datastore/v1new/types_test.py | 1 +
.../apache_beam/io/gcp/experimental/spannerio.py | 5 +-
.../io/gcp/experimental/spannerio_read_it_test.py | 5 +-
.../gcp/experimental/spannerio_read_perf_test.py | 1 +
.../io/gcp/experimental/spannerio_test.py | 44 +-
.../io/gcp/experimental/spannerio_write_it_test.py | 5 +-
.../gcp/experimental/spannerio_write_perf_test.py | 1 +
sdks/python/apache_beam/io/gcp/gcsio.py | 2 +-
.../apache_beam/io/gcp/gcsio_integration_test.py | 1 +
sdks/python/apache_beam/io/gcp/gcsio_retry_test.py | 6 +-
sdks/python/apache_beam/io/gcp/gcsio_test.py | 8 +-
.../io/gcp/healthcare/dicomio_integration_test.py | 9 +-
.../io/gcp/internal/clients/bigquery/__init__.py | 1 +
.../apache_beam/io/gcp/pubsub_io_perf_test.py | 1 +
.../apache_beam/io/gcp/pubsublite/__init__.py | 3 +-
sdks/python/apache_beam/io/gcp/spanner.py | 56 +-
sdks/python/apache_beam/io/mongodbio.py | 1 -
sdks/python/apache_beam/io/parquetio.py | 1 +
.../apache_beam/io/requestresponse_it_test.py | 1 +
sdks/python/apache_beam/io/requestresponse_test.py | 1 +
sdks/python/apache_beam/io/textio_test.py | 4 +-
sdks/python/apache_beam/io/tfrecordio.py | 1 +
sdks/python/apache_beam/metrics/cells.py | 131 +
sdks/python/apache_beam/metrics/cells_test.py | 51 +
sdks/python/apache_beam/metrics/execution.py | 6 +-
sdks/python/apache_beam/metrics/metric.py | 44 +
sdks/python/apache_beam/metrics/metric_test.py | 38 +-
.../python/apache_beam/metrics/monitoring_infos.py | 2 +-
.../apache_beam/metrics/monitoring_infos_test.py | 4 +-
.../apache_beam/ml/anomaly/detectors/__init__.py | 4 +-
.../ml/anomaly/detectors/pyod_adapter.py | 2 +-
.../ml/anomaly/detectors/pyod_adapter_test.py | 3 +-
sdks/python/apache_beam/ml/gcp/cloud_dlp_test.py | 3 +-
.../apache_beam/ml/gcp/recommendations_ai_test.py | 1 +
.../ml/gcp/recommendations_ai_test_it.py | 1 +
.../apache_beam/ml/gcp/videointelligenceml_test.py | 3 +-
.../ml/gcp/videointelligenceml_test_it.py | 4 +-
sdks/python/apache_beam/ml/gcp/visionml_test.py | 3 +-
sdks/python/apache_beam/ml/gcp/visionml_test_it.py | 4 +-
.../apache_beam/ml/inference/gemini_inference.py | 42 +-
.../ml/inference/gemini_inference_it_test.py | 25 +
.../ml/inference/gemini_inference_test.py | 5 +-
.../ml/inference/gemini_tests_requirements.txt | 3 +-
.../ml/inference/huggingface_inference.py | 21 +-
.../ml/inference/huggingface_inference_test.py | 35 +-
.../apache_beam/ml/inference/onnx_inference.py | 2 +-
.../ml/inference/onnx_inference_it_test.py | 1 +
.../ml/inference/onnx_inference_test.py | 9 +-
.../apache_beam/ml/inference/pytorch_inference.py | 1 +
.../ml/inference/pytorch_inference_it_test.py | 3 +-
.../ml/inference/pytorch_inference_test.py | 7 +-
.../ml/inference/tensorflow_inference.py | 2 +-
.../ml/inference/tensorflow_inference_it_test.py | 1 +
.../ml/inference/tensorflow_inference_test.py | 6 +-
.../apache_beam/ml/inference/tensorrt_inference.py | 2 +-
.../ml/inference/tensorrt_inference_test.py | 7 +-
.../ml/inference/test_resources/vllm.dockerfile | 14 +-
.../ml/inference/vertex_ai_inference_test.py | 5 +-
.../apache_beam/ml/inference/vllm_inference.py | 5 +-
.../ml/inference/vllm_tests_requirements.txt | 2 +-
.../apache_beam/ml/inference/xgboost_inference.py | 4 +-
.../ml/inference/xgboost_inference_it_test.py | 3 +-
.../apache_beam/ml/rag/chunking/langchain_test.py | 7 +-
.../ml/rag/embeddings/vertex_ai_test.py | 1 +
.../enrichment/bigquery_vector_search_it_test.py | 6 +-
.../apache_beam/ml/rag/enrichment/milvus_search.py | 50 +-
.../ml/rag/enrichment/milvus_search_it_test.py | 62 +-
.../ml/rag/enrichment/milvus_search_test.py | 21 +-
.../python/apache_beam/ml/rag/ingestion/spanner.py | 646 +++++
.../ml/rag/ingestion/spanner_it_test.py | 601 +++++
.../ml/transforms/embeddings/huggingface_test.py | 8 +-
.../ml/transforms/embeddings/open_ai.py | 7 +-
.../ml/transforms/embeddings/tensorflow_hub.py | 3 +-
.../transforms/embeddings/tensorflow_hub_test.py | 4 +-
.../ml/transforms/embeddings/vertex_ai.py | 18 +-
.../ml/transforms/embeddings/vertex_ai_test.py | 9 +-
sdks/python/apache_beam/ml/transforms/handlers.py | 18 +-
.../apache_beam/ml/transforms/handlers_test.py | 7 +-
sdks/python/apache_beam/ml/transforms/tft.py | 5 +-
sdks/python/apache_beam/ml/transforms/utils.py | 2 +-
.../python/apache_beam/options/pipeline_options.py | 68 +-
.../apache_beam/options/pipeline_options_test.py | 24 +-
sdks/python/apache_beam/pipeline.py | 1 +
sdks/python/apache_beam/pipeline_test.py | 2 +-
sdks/python/apache_beam/pvalue.py | 6 +-
sdks/python/apache_beam/runners/__init__.py | 3 +-
sdks/python/apache_beam/runners/common.py | 6 +-
.../runners/dask/transform_evaluator.py | 3 +-
.../runners/dataflow/dataflow_runner.py | 19 +-
.../runners/dataflow/internal/apiclient.py | 2 +-
.../runners/dataflow/internal/apiclient_test.py | 4 +-
.../internal/clients/cloudbuild/__init__.py | 1 +
.../dataflow/internal/clients/dataflow/__init__.py | 3 +-
.../apache_beam/runners/dataflow/internal/names.py | 2 +-
.../runners/dataflow/ptransform_overrides.py | 2 +-
.../apache_beam/runners/direct/direct_runner.py | 13 +-
.../runners/direct/evaluation_context.py | 3 +-
.../runners/direct/transform_evaluator.py | 7 +-
.../runners/interactive/augmented_pipeline.py | 2 +-
.../interactive/background_caching_job_test.py | 1 +
.../runners/interactive/caching/cacheable.py | 1 +
.../dataproc/dataproc_cluster_manager.py | 3 +-
.../runners/interactive/display/display_manager.py | 1 +
.../interactive/display/pcoll_visualization.py | 3 +-
.../runners/interactive/display/pipeline_graph.py | 7 +-
.../runners/interactive/interactive_beam.py | 30 +-
.../runners/interactive/interactive_beam_test.py | 85 +
.../runners/interactive/interactive_environment.py | 3 +-
.../runners/interactive/interactive_runner.py | 2 +-
.../runners/interactive/pipeline_instrument.py | 2 +-
.../interactive/pipeline_instrument_test.py | 4 +-
.../runners/interactive/sql/beam_sql_magics.py | 7 +-
.../interactive/sql/beam_sql_magics_test.py | 2 +-
.../apache_beam/runners/interactive/utils.py | 4 +
.../apache_beam/runners/interactive/utils_test.py | 3 +-
.../python/apache_beam/runners/pipeline_context.py | 1 +
.../runners/portability/expansion_service.py | 12 +-
.../portability/fn_api_runner/worker_handlers.py | 9 +-
.../runners/portability/local_job_service.py | 1 -
.../runners/portability/portable_runner.py | 14 +-
.../runners/portability/prism_runner.py | 18 +-
sdks/python/apache_beam/runners/runner.py | 4 +-
.../apache_beam/runners/worker/bundle_processor.py | 28 +-
.../apache_beam/runners/worker/data_plane.py | 20 +-
.../apache_beam/runners/worker/operations.py | 2 +-
.../apache_beam/runners/worker/sdk_worker.py | 19 +-
.../apache_beam/runners/worker/sdk_worker_main.py | 4 +
.../apache_beam/runners/worker/sdk_worker_test.py | 44 +-
.../apache_beam/runners/worker/worker_status.py | 118 +-
.../runners/worker/worker_status_test.py | 96 +-
.../testing/analyzers/perf_analysis_test.py | 4 +-
.../testing/analyzers/perf_analysis_utils.py | 2 +-
.../benchmarks/cloudml/pipelines/workflow.py | 5 +-
.../testing/benchmarks/inference/README.md | 100 +-
.../pytorch_image_classification_benchmarks.py | 3 +-
.../benchmarks/inference/vllm_gemma_benchmarks.py | 2 +-
.../benchmarks/nexmark/models/auction_bid.py | 3 +-
.../benchmarks/nexmark/models/nexmark_model.py | 27 +-
.../testing/benchmarks/nexmark/nexmark_util.py | 18 -
.../testing/metric_result_matchers_test.py | 2 +-
.../apache_beam/testing/pipeline_verifiers_test.py | 1 +
.../apache_beam/tools/coders_microbenchmark.py | 2 +-
sdks/python/apache_beam/transforms/async_dofn.py | 44 +-
.../apache_beam/transforms/async_dofn_test.py | 39 +-
sdks/python/apache_beam/transforms/combiners.py | 1 +
sdks/python/apache_beam/transforms/core.py | 36 +-
sdks/python/apache_beam/transforms/core_it_test.py | 43 +-
sdks/python/apache_beam/transforms/core_test.py | 16 +-
.../enrichment_handlers/bigquery_it_test.py | 6 +-
.../enrichment_handlers/bigtable_it_test.py | 1 +
.../enrichment_handlers/cloudsql_it_test.py | 31 +-
.../enrichment_handlers/cloudsql_test.py | 21 +-
.../enrichment_handlers/feast_feature_store.py | 3 +-
.../feast_feature_store_it_test.py | 6 +-
.../feast_feature_store_test.py | 6 +-
.../vertex_ai_feature_store_it_test.py | 6 +-
.../vertex_ai_feature_store_test.py | 7 +-
sdks/python/apache_beam/transforms/external.py | 43 +-
.../python/apache_beam/transforms/external_test.py | 22 +-
sdks/python/apache_beam/transforms/managed.py | 49 +-
.../transforms/maven_repository_url_test.py | 224 ++
.../apache_beam/transforms/periodicsequence.py | 3 +-
sdks/python/apache_beam/transforms/ptransform.py | 15 +-
.../apache_beam/transforms/ptransform_test.py | 32 +
sdks/python/apache_beam/transforms/trigger_test.py | 1 +
sdks/python/apache_beam/transforms/userstate.py | 1 +
sdks/python/apache_beam/transforms/util.py | 24 +-
sdks/python/apache_beam/transforms/util_test.py | 64 +-
.../transforms/validate_runner_xlang_test.py | 96 +
sdks/python/apache_beam/transforms/window_test.py | 13 +
sdks/python/apache_beam/typehints/__init__.py | 4 +-
sdks/python/apache_beam/typehints/decorators.py | 2 +-
.../typehints/native_type_compatibility.py | 16 +
.../typehints/native_type_compatibility_test.py | 18 +
.../typehints/pytorch_type_compatibility.py | 1 +
.../typehints/pytorch_type_compatibility_test.py | 1 +
sdks/python/apache_beam/utils/interactive_utils.py | 1 +
sdks/python/apache_beam/utils/logger.py | 137 +
sdks/python/apache_beam/utils/logger_test.py | 108 +
sdks/python/apache_beam/utils/subprocess_server.py | 31 +-
sdks/python/apache_beam/version.py | 2 +-
sdks/python/apache_beam/yaml/integration_tests.py | 2 +-
sdks/python/apache_beam/yaml/json_utils.py | 7 +-
sdks/python/apache_beam/yaml/main_test.py | 6 +
sdks/python/apache_beam/yaml/standard_io.yaml | 2 +-
sdks/python/apache_beam/yaml/yaml_io_test.py | 6 +
sdks/python/apache_beam/yaml/yaml_mapping_test.py | 6 +
sdks/python/apache_beam/yaml/yaml_ml.py | 1 +
sdks/python/apache_beam/yaml/yaml_provider.py | 33 +-
.../apache_beam/yaml/yaml_specifiable_test.py | 7 +-
.../python/apache_beam/yaml/yaml_transform_test.py | 6 +
.../apache_beam/yaml/yaml_transform_unit_test.py | 1 +
sdks/python/container/Dockerfile | 2 +-
sdks/python/container/build.gradle | 8 +-
sdks/python/container/common.gradle | 25 +-
.../container/license_scripts/dep_urls_py.yaml | 4 +
sdks/python/container/ml/common.gradle | 2 +-
.../container/ml/py310/base_image_requirements.txt | 209 +-
.../gpu_image_requirements.txt} | 216 +-
.../container/ml/py311/base_image_requirements.txt | 209 +-
.../gpu_image_requirements.txt} | 211 +-
.../container/ml/py312/base_image_requirements.txt | 208 +-
.../gpu_image_requirements.txt} | 212 +-
...equirements.txt => base_image_requirements.txt} | 153 +-
.../container/ml/py39/base_image_requirements.txt | 189 +-
.../container/py310/base_image_requirements.txt | 109 +-
.../container/py311/base_image_requirements.txt | 109 +-
.../container/py312/base_image_requirements.txt | 109 +-
.../container/py313/base_image_requirements.txt | 118 +-
.../container/py39/base_image_requirements.txt | 105 +-
sdks/python/container/run_generate_requirements.sh | 17 +-
sdks/python/container/run_validatescontainer.sh | 21 +-
sdks/python/expansion-service-container/Dockerfile | 4 +-
sdks/python/gen_managed_doc.py | 3 +-
sdks/python/gen_xlang_wrappers.py | 1 -
sdks/python/mypy.ini | 2 +-
sdks/python/scripts/run_pylint.sh | 5 +-
sdks/python/scripts/run_pytest.sh | 2 +-
sdks/python/setup.cfg | 3 -
sdks/python/setup.py | 36 +-
sdks/python/test-suites/direct/xlang/build.gradle | 1 +
sdks/python/test-suites/gradle.properties | 26 +-
sdks/python/test-suites/tox/common.gradle | 5 +-
sdks/python/test-suites/tox/py310/build.gradle | 206 ++
sdks/python/tox.ini | 58 +-
sdks/typescript/package.json | 2 +-
settings.gradle.kts | 1 +
website/www/site/config.toml | 2 +-
website/www/site/content/en/blog/beam-2.69.0.md | 86 +
.../en/blog/gsoc-25-jupyterlab-extensions.md | 74 +
.../en/documentation/dsls/sql/calcite/overview.md | 27 +
.../dsls/sql/calcite/scalar-functions.md | 9 +-
.../content/en/documentation/dsls/sql/shell.md | 114 +-
.../en/documentation/dsls/sql/zetasql/overview.md | 2 +-
.../site/content/en/documentation/io/managed-io.md | 1635 ++++++++++--
.../en/documentation/runtime/environments.md | 3 +-
.../www/site/content/en/documentation/sdks/java.md | 29 +
.../content/en/documentation/sdks/java/euphoria.md | 2 +
.../site/content/en/documentation/sdks/python.md | 51 +-
.../python/elementwise/enrichment-cloudsql.md | 4 +-
.../python/elementwise/enrichment-milvus.md | 65 +
.../transforms/python/elementwise/enrichment.md | 3 +-
.../www/site/content/en/get-started/downloads.md | 18 +-
website/www/site/content/en/roadmap/_index.md | 19 +-
.../www/site/content/en/security/CVE-2020-1929.md | 16 -
website/www/site/data/authors.yml | 3 +
website/www/site/data/performance.yaml | 10 +-
.../partials/section-menu/en/documentation.html | 1 +
.../gsoc-25-jupyterlab-extensions/Yaml_main.png | Bin 0 -> 305413 bytes
675 files changed, 23781 insertions(+), 7544 deletions(-)
copy .github/trigger_files/{beam_PostCommit_Java_PVR_Flink_Streaming.json =>
beam_PostCommit_Go_VR_Spark.json} (53%)
copy .github/trigger_files/{beam_CloudML_Benchmarks_Dataflow.json =>
beam_PostCommit_XVR_JavaUsingPython_Dataflow.json} (98%)
copy .github/trigger_files/{beam_CloudML_Benchmarks_Dataflow.json =>
beam_PostCommit_XVR_PythonUsingJava_Dataflow.json} (100%)
copy .github/trigger_files/{beam_PostCommit_Java_Examples_Dataflow_ARM.json =>
beam_PostCommit_XVR_Spark3.json} (100%)
copy .github/trigger_files/{beam_PreCommit_Flink_Container.json =>
beam_PreCommit_Python_Dill.json} (80%)
delete mode 100644
.github/workflows/load-tests-pipeline-options/python_CoGBK_Dataflow_Flink_Batch_100b_Single_Key.txt
delete mode 100644
.github/workflows/load-tests-pipeline-options/python_CoGBK_Dataflow_Flink_Batch_10kB.txt
rename
.github/workflows/load-tests-pipeline-options/{python_CoGBK_Dataflow_Flink_Batch_100b_Multiple_Keys.txt
=> python_CoGBK_Flink_Batch_100b_Multiple_Keys.txt} (74%)
copy
.github/workflows/load-tests-pipeline-options/{python_Combine_Flink_Streaming_small_Fanout_1.txt
=> python_CoGBK_Flink_Batch_100b_Single_Key.txt} (75%)
copy
.github/workflows/load-tests-pipeline-options/{python_Combine_Flink_Streaming_small_Fanout_1.txt
=> python_CoGBK_Flink_Batch_10kB.txt} (75%)
copy
examples/java/src/main/java/org/apache/beam/examples/cookbook/{BigQueryTornadoes.java
=> BigQueryStreamingTornadoes.java} (72%)
create mode 100644 examples/notebooks/beam-ml/milvus_enrichment_transform.ipynb
create mode 100644
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/util/common/worker/InternedByteString.java
rename
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/state/{WindmillStateUtil.java
=> WindmillStateTagUtil.java} (59%)
create mode 100644
runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/util/common/worker/InternedByteStringTest.java
rename
runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/windmill/state/{WindmillStateUtilTest.java
=> WindmillStateTagUtilTest.java} (82%)
create mode 100755 scripts/beam-sql.sh
copy sdks/go/pkg/beam/log/{standard.go => structural.go} (64%)
create mode 100644
sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/logicaltypes/Timestamp.java
create mode 100644
sdks/java/core/src/main/java/org/apache/beam/sdk/util/ExpiringMemoizingSerializableSupplier.java
create mode 100644
sdks/java/core/src/test/java/org/apache/beam/sdk/schemas/utils/AutoValueUtilsTest.java
copy
sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/{ViewTest.java =>
MapViewTest.java} (54%)
create mode 100644
sdks/java/core/src/test/java/org/apache/beam/sdk/util/ExpiringMemoizingSerializableSupplierTest.java
create mode 100644 sdks/java/extensions/kafka-factories/build.gradle
create mode 100644
sdks/java/extensions/kafka-factories/src/main/java/org/apache/beam/sdk/extensions/kafka/factories/FileAwareFactoryFn.java
create mode 100644
sdks/java/extensions/kafka-factories/src/main/java/org/apache/beam/sdk/extensions/kafka/factories/KerberosConsumerFactoryFn.java
copy
{.test-infra/mock-apis/src/main/java/org/apache/beam/testinfra/mockapis/echo/v1
=>
sdks/java/extensions/kafka-factories/src/main/java/org/apache/beam/sdk/extensions/kafka/factories}/package-info.java
(85%)
create mode 100644
sdks/java/extensions/kafka-factories/src/test/java/org/apache/beam/sdk/extensions/kafka/factories/FileAwareFactoryFnTest.java
create mode 100644
sdks/java/extensions/kafka-factories/src/test/java/org/apache/beam/sdk/extensions/kafka/factories/KerberosConsumerFactoryFnTest.java
create mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryDynamicReadDescriptor.java
copy
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/{BigQueryIOStorageQueryIT.java
=> BigQueryIODynamicQueryIT.java} (77%)
copy
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/{BigQueryIOStorageQueryIT.java
=> BigQueryIODynamicReadIT.java} (63%)
copy
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/{BigQueryIOStorageReadTableRowIT.java
=> BigQueryIODynamicReadTableRowIT.java} (89%)
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIODynamicReadTest.java
create mode 100644 sdks/python/.isort.cfg
copy {examples/notebooks/notebook_test_scripts =>
sdks/python/apache_beam/examples/cookbook/ordered_window_elements}/__init__.py
(100%)
create mode 100644
sdks/python/apache_beam/examples/cookbook/ordered_window_elements/batch.py
create mode 100644
sdks/python/apache_beam/examples/cookbook/ordered_window_elements/batch_test.py
create mode 100644
sdks/python/apache_beam/examples/cookbook/ordered_window_elements/streaming.py
create mode 100644
sdks/python/apache_beam/examples/cookbook/ordered_window_elements/streaming_test.py
copy sdks/python/apache_beam/examples/inference/{gemini_text_classification.py
=> gemini_image_generation.py} (72%)
delete mode 100644 sdks/python/apache_beam/internal/metrics/cells.py
delete mode 100644 sdks/python/apache_beam/internal/metrics/cells_test.py
delete mode 100644 sdks/python/apache_beam/internal/metrics/metric_test.py
create mode 100644 sdks/python/apache_beam/io/gcp/bigquery_geography_it_test.py
create mode 100644 sdks/python/apache_beam/ml/rag/ingestion/spanner.py
create mode 100644 sdks/python/apache_beam/ml/rag/ingestion/spanner_it_test.py
create mode 100644
sdks/python/apache_beam/transforms/maven_repository_url_test.py
create mode 100644 sdks/python/apache_beam/utils/logger.py
create mode 100644 sdks/python/apache_beam/utils/logger_test.py
copy sdks/python/container/ml/{py313/ml_image_requirements.txt =>
py310/gpu_image_requirements.txt} (57%)
copy sdks/python/container/ml/{py313/ml_image_requirements.txt =>
py311/gpu_image_requirements.txt} (58%)
copy sdks/python/container/ml/{py313/ml_image_requirements.txt =>
py312/gpu_image_requirements.txt} (58%)
rename sdks/python/container/ml/py313/{ml_image_requirements.txt =>
base_image_requirements.txt} (65%)
create mode 100644 website/www/site/content/en/blog/beam-2.69.0.md
create mode 100644
website/www/site/content/en/blog/gsoc-25-jupyterlab-extensions.md
create mode 100644
website/www/site/content/en/documentation/transforms/python/elementwise/enrichment-milvus.md
delete mode 100644 website/www/site/content/en/security/CVE-2020-1929.md
create mode 100644
website/www/site/static/images/blog/gsoc-25-jupyterlab-extensions/Yaml_main.png
