This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from f35ac208b3b Add 3 examples in playground SQL transform, schema
transform and Composite Combine (#34322)
add 2d61a3d5df2 Support expected and output asserting.
add 0eeef4c2ba8 Support input mocking.
add bf7a47cb1d5 Check for unmocked sources.
add 3b2cefddb3d Add unit testing abilities.
add 93c9323dcd8 Add test specification validation.
add 3cea81d8c58 Add a utility to rewrite yaml maximally preserving
formatting.
add 8c6fd44adb0 Yaml patching for unequal sized lists.
add bff6fb64b27 Add --fix-tests option to more easily generate YAML tests.
add 6764142b275 Add logic to automatically create a regression tests.
add e4697e5cc63 Add --create_test option to yaml main.py.
add 1a9efe64bf0 Refactor test updating into a separate method.
add 2d4ddd1622d Update readme tests to execute tests blocks.
add 11f214c4ed6 Add yaml testing documentation.
add ffe843a7d75 Some simplification and clarifiaction.
add 860a0da8077 Add missing parameter.
add fc0564cd3bd Make lint and isort simultaneously happy.
add c7fee3e3c8c Exclude isort as it disagress with yapf.
add 7136380c4a7 [Bug]: avro_dict_to_beam_row negative integer incorrectly
converts to uint (#34542)
add 7e7666e4d3a More eagerly merge compatible environments.
add cf27624947c Move the pipeline graph manipulation utilites to their own
files.
add 01b5bb9420e Use tempfile.mkdtemp as TemporaryDirectory's delete not
available pre 3.12.
add 78071e2b5cd Merge pull request #34583 More eagerly merge compatible
environments.
add ac184a6f500 Remove runtime check in generated test proto stubs to fix
internal tests. (#34589)
add 3558dd663f1 Add beam summit/college banners (#34588)
add 7c4eb7083b3 Upgrade some go dependencies and remove excludes (#34591)
add da8c5e069ce Fix coder corruption in prism while handling flatten
(#34582)
add e3ba73d0a04 Merge branch 'master' into yaml-testing-docs
add 3f3dc4f1a32 Workaround for unittest.main lint error.
add 9802a06ec44 Merge pull request #34569 Add the ability to unit test
YAML pipelines.
No new revisions were added by this update.
Summary of changes:
sdks/go.mod | 59 +--
sdks/go.sum | 112 ++---
.../beam/runners/prism/internal/handlerunner.go | 9 +-
.../coders/proto2_coder_test_messages_pb2.py | 9 -
sdks/python/apache_beam/io/avroio.py | 57 +--
sdks/python/apache_beam/io/avroio_test.py | 22 -
sdks/python/apache_beam/pipeline.py | 4 +-
sdks/python/apache_beam/runners/common.py | 162 -------
sdks/python/apache_beam/runners/common_test.py | 59 ---
.../runners/dataflow/dataflow_runner.py | 8 +-
.../runners/dataflow/dataflow_runner_test.py | 10 +-
.../runners/dataflow/internal/apiclient.py | 2 +-
sdks/python/apache_beam/runners/pipeline_utils.py | 258 ++++++++++
.../apache_beam/runners/pipeline_utils_test.py | 196 ++++++++
.../runners/portability/fn_api_runner/fn_runner.py | 10 +-
sdks/python/apache_beam/runners/runner.py | 2 +-
sdks/python/apache_beam/yaml/main.py | 137 +++++-
sdks/python/apache_beam/yaml/main_test.py | 114 +++++
sdks/python/apache_beam/yaml/readme_test.py | 26 +-
sdks/python/apache_beam/yaml/yaml_testing.py | 528 +++++++++++++++++++++
sdks/python/apache_beam/yaml/yaml_testing_test.py | 231 +++++++++
sdks/python/apache_beam/yaml/yaml_transform.py | 23 +-
sdks/python/apache_beam/yaml/yaml_utils.py | 164 +++++++
sdks/python/apache_beam/yaml/yaml_utils_test.py | 140 ++++++
sdks/python/scripts/run_pylint.sh | 2 +
.../content/en/documentation/sdks/yaml-testing.md | 303 ++++++++++++
.../site/content/en/documentation/sdks/yaml-udf.md | 3 +
website/www/site/layouts/partials/header.html | 12 +
.../layouts/partials/section-menu/en/sdks.html | 1 +
.../beam-college/beam-college-25-desktop.png | Bin 0 -> 230979 bytes
.../beam-college/beam-college-25-mobile.png | Bin 0 -> 113671 bytes
.../banners/beam-summit/beam-summit-25-desktop.png | Bin 0 -> 93173 bytes
.../banners/beam-summit/beam-summit-25-mobile.png | Bin 0 -> 85550 bytes
33 files changed, 2229 insertions(+), 434 deletions(-)
create mode 100644 sdks/python/apache_beam/runners/pipeline_utils.py
create mode 100644 sdks/python/apache_beam/runners/pipeline_utils_test.py
create mode 100644 sdks/python/apache_beam/yaml/yaml_testing.py
create mode 100644 sdks/python/apache_beam/yaml/yaml_testing_test.py
create mode 100644
website/www/site/content/en/documentation/sdks/yaml-testing.md
create mode 100644
website/www/site/static/images/banners/beam-college/beam-college-25-desktop.png
create mode 100644
website/www/site/static/images/banners/beam-college/beam-college-25-mobile.png
create mode 100644
website/www/site/static/images/banners/beam-summit/beam-summit-25-desktop.png
create mode 100644
website/www/site/static/images/banners/beam-summit/beam-summit-25-mobile.png
