This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.53.1
in repository https://gitbox.apache.org/repos/asf/beam.git
discard 580ebba3e41 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
add 9e98ada9ac6 [YAML] Interpret PDone as no outputs.
add bd1945e3b8a Allow implicit n-arry outputs of chain composite and
pipelines.
add a841c55054f Fix change-detector test.
add 040dba18f81 Merge pull request #30862 Better handling of no-output
transforms.
add 358c88d2656 Proposed edits for Beam YAML overview
add 747d7c78a7a Merge pull request #30842 Proposed edits for Beam YAML
overview
add ef3a942aa42 WiP: Day Zero Tutorial
add 9a28286c5e7 WiP: Yaml Day Zero tutorial.
add c89af58a39d Python Notebook for getting started with Yaml API
add 814eda6b6f3 Small changes to Getting started with yaml notebook
add 226c2532c21 Yaml notebooks: formatting
add 1ec22aeefe6 Yaml notebooks: change second pipeline to chain
add 789a2ce42fa Small content fixes in the getting started with yaml
notebook
add dd23eeaa3d8 Adding word count example to the yaml notebook.
add e3667016565 Clear outputs of the notebook
add 8bcb0aaa9f8 Apply PR comments. Add more information on structure of
yaml pipelines
add 3fb02dbe4d7 Switching from`gsutil cp` to `wget`. Dropping introduced
SumPer key transform in favour of CombinePerKey with a callable argument
add c863b676014 Fixing after the merge
add 9c3adbae86c Editorial suggestions
add aabea011ec8 Remove dash in the content of Getting Started with Yaml
add c701db3fff6 Fix typos
add 1f875af31af Modify Getting Started Notebook - add simpler examples
add 34b6a0c426a WiP: Day Zero Tutorial
add 6ac7336c498 WiP: Yaml Day Zero tutorial.
add 141abb55665 Merge branch 'master' into yaml_day_zero_tutorial
add aa4a0dee4c9 Python Notebook for getting started with Yaml API
add 89582f2f83f Add SumPerKey and TopNLargest transforms to Yaml api
add abc777f9776 Small changes to Getting started with yaml notebook
add a39362cf14b Yaml notebooks: formatting
add dee90b2a14a Yaml notebooks: change second pipeline to chain
add a4a9cedc58f Small content fixes in the getting started with yaml
notebook
add a6b5c4eb963 Adding word count example to the yaml notebook.
add fd00b1ff57d Clear outputs of the notebook
add d13f4ed1483 Apply PR comments. Add more information on structure of
yaml pipelines
add bbf7f7d2060 Switching from`gsutil cp` to `wget`. Dropping introduced
SumPer key transform in favour of CombinePerKey with a callable argument
add 00ba6c64b9f Merge branch 'master' into yaml_day_zero_tutorial
add 781ee6d77b7 Fixing after the merge
add 615c746691d Editorial suggestions
add 50c8170c4c7 Remove dash in the content of Getting Started with Yaml
add 373b9e04f7c Fix typos
add d4d2b4d76aa Merge remote-tracking branch
'origin/yaml_day_zero_tutorial' into yaml_day_zero_tutorial
add 048c9557db4 Merge branch 'master' into yaml_day_zero_tutorial
add f20bfe6002f Merge remote-tracking branch 'upstream/master' into
yaml_day_zero_tutorial
add bb760acdcbf Review comments
add 3242fcb6384 Review comments
add ada5e62dfa5 Update
examples/notebooks/get-started/try-apache-beam-yaml.ipynb
add ccf2a5056a6 remove the last code block
add a38fe29d184 Merge remote-tracking branch 'origin/master' into
yaml_day_zero_tutorial
add fad13cdcdc2 Add a link to documentation. Add an explanation on
expansion service.
add 239c0d507f5 typo
add 176c835f964 Merge branch 'master' into yaml_day_zero_tutorial
add ee6da7a1b33 Use %%writefile instead of custom python function
add 60829dc8fc5 Install apache-beam command without --update
add 3da0b066c4e Install apache-beam[yaml]
add a475fdeeb55 Merge pull request #27284 Yaml API: Day Zero tutorial
notebook
add 6f7c6875368 Correct the version spec (#30856)
add 55f5a43eb37 Remove outdated comment about docker. (#30871)
add 2e630ac3675 Lower various logging statement levels to clean up example
printing (#30782)
add f1a47efc642 Allow lazy iteration for non-reiterables. (#30851)
add 1dfd39bc6d0 Fix merging with missing environments. (#30864)
add 4452a6c8d97 Adds a bound on pydantic to exclude incompatible versions
in the compat test. (#30863)
add 3c9e9c80e3b Add identity function as default to FlatMap (#30744)
add 54673996c9b [Java] ManagedIO (#30808)
add 58e4f8325fc Patch release website changes (#30839)
add 1c962a5ec7a Duet AI Prompts - Documentation Lookup Without Links
(#30873)
add f39a179fbf3 Bump github.com/aws/smithy-go from 1.20.1 to 1.20.2 in
/sdks (#30883)
add 9e8f084ce05 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (580ebba3e41)
\
N -- N -- N
refs/heads/dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.53.1
(9e8f084ce05)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
CHANGES.md | 8 +
build.gradle.kts | 1 +
.../get-started/try-apache-beam-yaml.ipynb | 734 +++++++++++++++++++++
.../01_basic_learning_apache_beam.md | 16 +
.../02_basic_pipelines.md | 18 +
.../03_basic_configuring_pipelines.md | 31 +
.../04_basic_pcollections.md | 8 +-
.../05_basic_ptransforms.md | 34 +
.../06_basic_schema.md | 25 +
.../07_basic_runners.md | 25 +
.../08_basic_windowing.md | 31 +
.../09_basic_triggers.md | 31 +
.../10_basic_metrics.md | 13 +-
.../documentation-lookup-nolinks/11_basic_state.md | 19 +
.../12_basic_timers.md | 11 +
.../13_advanced_splittable_dofn.md | 14 +-
.../14_advanced_pipeline_patterns.md | 14 +
.../15_advanced_xlang.md | 11 +
.../16_advanced_pipeline_lifecycle.md | 13 +-
.../17_advanced_ai_ml.md | 18 +
.../documentation-lookup-nolinks/18_io_kafka.md | 29 +
.../documentation-lookup-nolinks/19_io_pubsub.md | 23 +
.../documentation-lookup-nolinks/20_io_biguery.md | 42 ++
.../documentation-lookup-nolinks/21_io_bigtable.md | 28 +
.../documentation-lookup-nolinks/22_io_spanner.md | 33 +
.../documentation-lookup-nolinks/23_io_gcs.md | 15 +
.../documentation-lookup-nolinks/24_io_json.md | 29 +
.../documentation-lookup-nolinks/25_io_csv.md | 30 +
.../documentation-lookup-nolinks/26_io_avro.md | 25 +
.../documentation-lookup-nolinks/27_io_parquet.md | 21 +
.../documentation-lookup-nolinks/28_io_jdbc.md | 42 ++
.../29_advanced_side_inputs.md | 36 +
.../30_advanced_additional_outputs.md | 100 +++
.../31_advanced_batched_dofn.md | 39 ++
.../53_dataflow_runner.md | 80 +++
.../54_spark_runner.md | 148 +++++
.../55_direct_runner.md | 68 ++
.../documentation-lookup/04_basic_pcollections.md | 6 +-
.../documentation-lookup/05_basic_ptransforms.md | 4 +-
.../documentation-lookup/06_basic_schema.md | 8 +-
.../documentation-lookup/07_basic_runners.md | 10 +-
.../documentation-lookup/08_basic_windowing.md | 14 +-
.../documentation-lookup/09_basic_triggers.md | 14 +-
.../documentation-lookup/10_basic_metrics.md | 9 +-
.../prompts/documentation-lookup/11_basic_state.md | 23 +-
.../documentation-lookup/12_basic_timers.md | 7 +-
.../13_advanced_splittable_dofn.md | 12 +-
.../14_advanced_pipeline_patterns.md | 5 +-
.../documentation-lookup/15_advanced_xlang.md | 10 +-
.../16_advanced_pipeline_lifecycle.md | 9 +-
.../documentation-lookup/17_advanced_ai_ml.md | 5 +-
.../prompts/documentation-lookup/18_io_kafka.md | 11 +-
.../prompts/documentation-lookup/19_io_pubsub.md | 13 +-
.../prompts/documentation-lookup/20_io_biguery.md | 18 +-
.../prompts/documentation-lookup/21_io_bigtable.md | 9 +-
.../prompts/documentation-lookup/22_io_spanner.md | 6 +-
learning/prompts/documentation-lookup/23_io_gcs.md | 15 +-
.../prompts/documentation-lookup/24_io_json.md | 8 +-
learning/prompts/documentation-lookup/25_io_csv.md | 7 +-
.../prompts/documentation-lookup/26_io_avro.md | 8 +-
.../prompts/documentation-lookup/27_io_parquet.md | 6 +-
.../prompts/documentation-lookup/28_io_jdbc.md | 9 +-
.../30_advanced_additional_outputs.md | 12 +-
.../31_advanced_batched_dofn.md | 27 +-
sdks/java/core/build.gradle | 1 +
.../apache/beam/sdk/schemas/utils/YamlUtils.java | 171 +++++
.../beam/sdk/transforms/join/CoGbkResult.java | 256 ++++++-
.../beam/sdk/transforms/join/CoGbkResultTest.java | 89 ++-
.../org/apache/beam/sdk/util/YamlUtilsTest.java | 228 +++++++
sdks/java/managed/build.gradle | 37 ++
.../java/org/apache/beam/sdk/managed/Managed.java | 195 ++++++
.../managed/ManagedSchemaTransformProvider.java | 183 +++++
.../org/apache/beam/sdk/managed/package-info.java | 20 +
.../ManagedSchemaTransformProviderTest.java | 103 +++
.../org/apache/beam/sdk/managed/ManagedTest.java | 114 ++++
.../sdk/managed/TestSchemaTransformProvider.java | 98 +++
.../managed/src/test/resources/test_config.yaml | 21 +
.../transforms/elementwise/flatmap_nofunction.py | 54 ++
.../transforms/elementwise/flatmap_test.py | 7 +
sdks/python/apache_beam/internal/gcp/auth.py | 4 +-
sdks/python/apache_beam/runners/common.py | 17 +-
.../portability/fn_api_runner/translations.py | 3 -
.../portability/fn_api_runner/worker_handlers.py | 2 +-
sdks/python/apache_beam/transforms/core.py | 10 +-
sdks/python/apache_beam/transforms/core_test.py | 11 +
sdks/python/apache_beam/yaml/yaml_transform.py | 15 +-
.../apache_beam/yaml/yaml_transform_unit_test.py | 3 +-
sdks/python/setup.py | 2 +-
sdks/python/tox.ini | 8 +-
settings.gradle.kts | 2 +
website/www/site/config.toml | 2 +-
.../www/site/content/en/documentation/sdks/yaml.md | 242 ++++---
.../transforms/python/elementwise/flatmap.md | 22 +-
.../www/site/content/en/get-started/downloads.md | 13 +-
94 files changed, 3746 insertions(+), 335 deletions(-)
create mode 100644 examples/notebooks/get-started/try-apache-beam-yaml.ipynb
create mode 100644
learning/prompts/documentation-lookup-nolinks/01_basic_learning_apache_beam.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/02_basic_pipelines.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/03_basic_configuring_pipelines.md
copy learning/prompts/{documentation-lookup =>
documentation-lookup-nolinks}/04_basic_pcollections.md (70%)
create mode 100644
learning/prompts/documentation-lookup-nolinks/05_basic_ptransforms.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/06_basic_schema.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/07_basic_runners.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/08_basic_windowing.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/09_basic_triggers.md
copy learning/prompts/{documentation-lookup =>
documentation-lookup-nolinks}/10_basic_metrics.md (57%)
create mode 100644
learning/prompts/documentation-lookup-nolinks/11_basic_state.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/12_basic_timers.md
copy learning/prompts/{documentation-lookup =>
documentation-lookup-nolinks}/13_advanced_splittable_dofn.md (55%)
create mode 100644
learning/prompts/documentation-lookup-nolinks/14_advanced_pipeline_patterns.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/15_advanced_xlang.md
copy learning/prompts/{documentation-lookup =>
documentation-lookup-nolinks}/16_advanced_pipeline_lifecycle.md (59%)
create mode 100644
learning/prompts/documentation-lookup-nolinks/17_advanced_ai_ml.md
create mode 100644 learning/prompts/documentation-lookup-nolinks/18_io_kafka.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/19_io_pubsub.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/20_io_biguery.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/21_io_bigtable.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/22_io_spanner.md
create mode 100644 learning/prompts/documentation-lookup-nolinks/23_io_gcs.md
create mode 100644 learning/prompts/documentation-lookup-nolinks/24_io_json.md
create mode 100644 learning/prompts/documentation-lookup-nolinks/25_io_csv.md
create mode 100644 learning/prompts/documentation-lookup-nolinks/26_io_avro.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/27_io_parquet.md
create mode 100644 learning/prompts/documentation-lookup-nolinks/28_io_jdbc.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/29_advanced_side_inputs.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/30_advanced_additional_outputs.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/31_advanced_batched_dofn.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/53_dataflow_runner.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/54_spark_runner.md
create mode 100644
learning/prompts/documentation-lookup-nolinks/55_direct_runner.md
create mode 100644
sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/utils/YamlUtils.java
create mode 100644
sdks/java/core/src/test/java/org/apache/beam/sdk/util/YamlUtilsTest.java
create mode 100644 sdks/java/managed/build.gradle
create mode 100644
sdks/java/managed/src/main/java/org/apache/beam/sdk/managed/Managed.java
create mode 100644
sdks/java/managed/src/main/java/org/apache/beam/sdk/managed/ManagedSchemaTransformProvider.java
create mode 100644
sdks/java/managed/src/main/java/org/apache/beam/sdk/managed/package-info.java
create mode 100644
sdks/java/managed/src/test/java/org/apache/beam/sdk/managed/ManagedSchemaTransformProviderTest.java
create mode 100644
sdks/java/managed/src/test/java/org/apache/beam/sdk/managed/ManagedTest.java
create mode 100644
sdks/java/managed/src/test/java/org/apache/beam/sdk/managed/TestSchemaTransformProvider.java
create mode 100644 sdks/java/managed/src/test/resources/test_config.yaml
create mode 100644
sdks/python/apache_beam/examples/snippets/transforms/elementwise/flatmap_nofunction.py
