This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 575df4e89ee Set default redistribute key limit for KafkaIO read.
(#36124)
add 5565f38c3de Bump actions/setup-node from 4 to 5 (#36182)
add d35bc38f950 Update dill requirement in /sdks/python (#36147)
add 98d4178baca [Dataflow Streaming] Reuse proto builders on hot path to
reduce GC overhead (#36164)
add cf7d4801ac0 docs(downloads): update source code download links to use
closer mirror (#36174)
add 0e727f0cb33 Touch trigger files to test separation of v1 worker and v2
sdk harness container image url parameters
add 5e256087536 Cleanly separate v1 worker and v2 sdk harness container
image handling in DataflowRunner
add 2b65f46bdb4 Merge pull request #36138: Cleanly separate v1 worker and
v2 sdk harness container image handling in DataflowRunner
add d69af5d19b9 Check whether notebook is running in colab environment
before doing auth. (#36180)
add 83fff0fb7c0 Use distroless container built from HEAD in Dataflow V2
integration tests
add f3222edf36b Merge pull request #36160: Use distroless container built
from HEAD in Dataflow V2 integration tests
add 9a5a357681d Import dill for test (#36149)
add f86452f32fb Support managed jdbc io (MySQL) (#36045)
add 117042c4ca5 Add liferoad to build reviewers list (#36186)
No new revisions were added by this update.
Summary of changes:
.github/REVIEWERS.yml | 1 +
.../beam_PostCommit_Java_DataflowV1.json | 1 +
.../beam_PostCommit_Java_DataflowV2.json | 1 +
...eam_PostCommit_Java_Examples_Dataflow_Java.json | 5 +-
.../beam_PostCommit_Java_Examples_Dataflow_V2.json | 1 +
.github/workflows/build_release_candidate.yml | 2 +-
.github/workflows/pr-bot-new-prs.yml | 2 +-
.github/workflows/pr-bot-pr-updates.yml | 2 +-
.github/workflows/pr-bot-prs-needing-attention.yml | 2 +-
.github/workflows/reportGenerator.yml | 2 +-
.github/workflows/typescript_tests.yml | 6 +-
contributor-docs/release-guide.md | 4 +-
.../alloydb_product_catalog_embeddings.ipynb | 24 ++-
.../anomaly_detection_iforest.ipynb | 6 +-
...cloudsql_mysql_product_catalog_embeddings.ipynb | 24 ++-
...udsql_postgres_product_catalog_embeddings.ipynb | 24 ++-
.../notebooks/beam-ml/dataflow_tpu_examples.ipynb | 6 +-
.../model/pipeline/v1/external_transforms.proto | 4 +
runners/google-cloud-dataflow-java/build.gradle | 201 ++++++++++-----------
.../dataflow/DataflowPipelineTranslator.java | 7 +-
.../beam/runners/dataflow/DataflowRunner.java | 127 ++++++++-----
.../options/DataflowPipelineWorkerPoolOptions.java | 13 +-
.../dataflow/DataflowPipelineTranslatorTest.java | 12 +-
.../beam/runners/dataflow/DataflowRunnerTest.java | 50 ++---
.../beam/runners/dataflow/worker/WindmillSink.java | 42 +++--
.../client/grpc/GetWorkResponseChunkAssembler.java | 6 +-
.../MySqlSchemaTransformTranslation.java} | 28 +--
.../ReadFromMySqlSchemaTransformProvider.java | 41 ++++-
.../WriteToMySqlSchemaTransformProvider.java | 31 +++-
...va => MysqlSchemaTransformTranslationTest.java} | 66 ++++---
.../java/org/apache/beam/sdk/managed/Managed.java | 3 +
sdks/python/apache_beam/transforms/external.py | 2 +
sdks/python/apache_beam/transforms/managed.py | 3 +
.../apache_beam/transforms/ptransform_test.py | 2 +
.../container/base_image_requirements_manual.txt | 2 +-
.../www/site/content/en/get-started/downloads.md | 150 +++++++--------
36 files changed, 515 insertions(+), 388 deletions(-)
copy
sdks/java/io/{kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaSchemaTransformTranslation.java
=>
jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/providers/MySqlSchemaTransformTranslation.java}
(75%)
copy
sdks/java/io/jdbc/src/test/java/org/apache/beam/sdk/io/jdbc/providers/{PostgresSchemaTransformTranslationTest.java
=> MysqlSchemaTransformTranslationTest.java} (77%)