This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/pip/sdks/python/container/pyyaml-5.1 in repository https://gitbox.apache.org/repos/asf/beam.git.
discard 354179d Bump pyyaml from 3.13 to 5.1 in /sdks/python/container add a80ae25 [BEAM-8540] Fix CSVSink example in FileIO docs add d7b2c0e Merge pull request #9964 from jklukas/csvsink-fix add 90abf5d [BEAM-8513] Allow reads from exchange-bound queue without declaring the exchange (#9937) add 9a41ce0 [BEAM-8521] only build Python 2.7 for xlang test add 980e655 Merge pull request #9939 from ibzib/xlang-version add c870c63 [BEAM-7917] Fix datastore writes failing on retry (#9294) add dfc230c Merge pull request #9741 from [BEAM-7926] Visualize PCollection add bebbba8 [BEAM-7389] Add code snippets for CombinePerKey (#9921) add 9e38cbe [BEAM-7389] Add code snippets for Distinct add 9d2d9df Merge pull request #9924 from davidcavazos/distinct-code add 9b30d7c [BEAM-8146,BEAM-8204,BEAM-8205] Add equals and hashCode to SchemaCoder and RowCoder (#9493) add 56d17fb Add separate testSQLRead and testSQLWrite test in BigQueryIT add d093625 Add PubsubJsonIT tests that pull and verify pubsub messages add 107ac28 Add TestPubsub#{waitForNMessages, assertThatTopicEventuallyReceives} add ed8401d Merge pull request #9880: [BEAM-8503] Improve TestBigQuery and TestPubsub add 1cb675a Add Jira priority explanations to Beam site add 2564cb9 Add release blocking section to Beam site add 902dddd Merge pull request #9862: Describe Jira priorities and release blockers on Beam site add d651434 [BEAM-8422] Notify builds@ on ABORTED job final state add 3d865bc Merge pull request #9816: [BEAM-8422] Notify builds@ on ABORTED job final state add 3626751 [BEAM-8491] Add ability for replacing transforms with multiple outputs (#9912) add 1664ce2 [BEAM-8467] Enabling reading compressed files (#9861) add a6936c8 [BEAM-3713] Add pytest for unit tests (#9756) add 5ce20cb Bump pyyaml from 3.13 to 5.1 in /sdks/python/container This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (354179d) \ N -- N -- N refs/heads/dependabot/pip/sdks/python/container/pyyaml-5.1 (5ce20cb) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .gitignore | 1 + .test-infra/jenkins/CommonJobProperties.groovy | 10 +- .test-infra/jenkins/PrecommitJobBuilder.groovy | 7 +- .test-infra/jenkins/job_PreCommit_Python.groovy | 15 + build.gradle | 8 + .../org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +- runners/apex/build.gradle | 6 +- runners/flink/flink_runner.gradle | 3 - .../util/SchemaCoderCloudObjectTranslator.java | 15 +- .../runners/dataflow/util/CloudObjectsTest.java | 12 +- .../java/org/apache/beam/sdk/coders/RowCoder.java | 7 +- .../main/java/org/apache/beam/sdk/io/AvroIO.java | 2 + .../main/java/org/apache/beam/sdk/io/FileIO.java | 10 +- .../apache/beam/sdk/schemas/AutoValueSchema.java | 59 ++-- .../apache/beam/sdk/schemas/AvroRecordSchema.java | 13 +- .../apache/beam/sdk/schemas/CachingFactory.java | 18 ++ .../beam/sdk/schemas/FromRowUsingCreator.java | 30 +- .../sdk/schemas/GetterBasedSchemaProvider.java | 73 ++++- .../apache/beam/sdk/schemas/JavaBeanSchema.java | 80 ++++-- .../apache/beam/sdk/schemas/JavaFieldSchema.java | 40 ++- .../org/apache/beam/sdk/schemas/SchemaCoder.java | 46 +++- .../beam/sdk/schemas/UserTypeCreatorFactory.java | 5 +- .../beam/sdk/schemas/transforms/Convert.java | 1 + .../sdk/schemas/transforms/SchemaAggregateFn.java | 4 +- .../apache/beam/sdk/schemas/utils/AvroUtils.java | 21 +- .../beam/sdk/schemas/utils/ConvertHelpers.java | 10 +- .../org/apache/beam/sdk/testing/TestStream.java | 4 +- .../org/apache/beam/sdk/transforms/Create.java | 24 +- .../java/org/apache/beam/sdk/transforms/ParDo.java | 10 +- .../apache/beam/sdk/util/SerializableUtils.java | 13 + .../org/apache/beam/sdk/values/PCollection.java | 10 +- .../beam/sdk/schemas/AutoValueSchemaTest.java | 31 +++ .../apache/beam/sdk/schemas/AvroSchemaTest.java | 16 ++ .../beam/sdk/schemas/JavaBeanSchemaTest.java | 13 + .../beam/sdk/schemas/JavaFieldSchemaTest.java | 15 +- .../apache/beam/sdk/schemas/SchemaCoderTest.java | 293 ++++++++++++++++++++ .../beam/sdk/schemas/transforms/ConvertTest.java | 8 +- .../org/apache/beam/sdk/transforms/CreateTest.java | 2 + .../beam/sdk/transforms/ParDoSchemaTest.java | 9 + .../datacatalog/DataCatalogBigQueryIT.java | 52 +--- .../provider/bigquery/BigQueryReadWriteIT.java | 155 ++++++++++- .../sql/meta/provider/pubsub/PubsubJsonIT.java | 79 ++++-- .../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 26 +- .../sdk/io/gcp/bigquery/BigQueryTableSource.java | 3 +- .../beam/sdk/io/gcp/bigquery/TestBigQuery.java | 54 +++- .../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java | 10 +- .../beam/sdk/io/gcp/pubsub/PubsubMessage.java | 10 + .../apache/beam/sdk/io/gcp/pubsub/TestPubsub.java | 90 +++++- .../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 2 + .../java/org/apache/beam/sdk/io/jdbc/JdbcIO.java | 5 +- sdks/java/io/rabbitmq/build.gradle | 5 +- .../apache/beam/sdk/io/rabbitmq/RabbitMqIO.java | 146 +++++++--- .../beam/sdk/io/rabbitmq/ExchangeTestPlan.java | 102 +++++++ .../beam/sdk/io/rabbitmq/RabbitMqIOTest.java | 301 ++++++++++++++++----- .../beam/sdk/io/rabbitmq/RabbitMqTestUtils.java | 90 ++++++ .../sdk/io/rabbitmq/rabbitmq-io-test-config.json | 30 ++ .../queries/sql/SqlBoundedSideInputJoin.java | 2 + .../sdk/nexmark/queries/sql/SqlQuery0Test.java | 2 + .../sdk/nexmark/queries/sql/SqlQuery1Test.java | 2 + .../apache_beam/coders/coders_test_common.py | 5 + .../transforms/aggregation/combineperkey.py | 270 ++++++++++++++++++ .../transforms/aggregation/combineperkey_test.py | 99 +++++++ .../keys.py => aggregation/distinct.py} | 25 +- .../keys_test.py => aggregation/distinct_test.py} | 18 +- sdks/python/apache_beam/io/fileio.py | 20 +- sdks/python/apache_beam/io/fileio_test.py | 64 +++++ .../io/gcp/datastore/v1new/datastoreio.py | 85 +++++- .../io/gcp/datastore/v1new/datastoreio_test.py | 79 ++++++ .../apache_beam/io/gcp/datastore/v1new/helper.py | 54 ---- .../io/gcp/datastore/v1new/helper_test.py | 85 ------ .../io/gcp/tests/bigquery_matcher_test.py | 2 + sdks/python/apache_beam/pipeline.py | 70 +++-- sdks/python/apache_beam/pipeline_test.py | 84 +++++- .../runners/dataflow/dataflow_runner_test.py | 3 + .../interactive/display/pcoll_visualization.py | 290 ++++++++++++++++++++ .../display/pcoll_visualization_test.py | 166 ++++++++++++ .../runners/interactive/interactive_environment.py | 97 +++++++ .../interactive/interactive_environment_test.py | 70 +++++ .../apache_beam/runners/portability/stager_test.py | 3 + sdks/python/apache_beam/runners/runner.py | 5 + sdks/python/apache_beam/transforms/ptransform.py | 4 +- sdks/python/apache_beam/transforms/window_test.py | 4 +- .../coders/avro_record.py => conftest.py} | 28 +- .../metrics/execution.pxd => pytest.ini} | 19 +- sdks/python/scripts/run_pytest.sh | 49 ++++ sdks/python/setup.py | 15 +- sdks/python/test-suites/tox/py2/build.gradle | 16 ++ sdks/python/test-suites/tox/py35/build.gradle | 15 + sdks/python/test-suites/tox/py36/build.gradle | 15 + sdks/python/test-suites/tox/py37/build.gradle | 19 ++ sdks/python/test_config.py | 1 + sdks/python/tox.ini | 108 +++++++- website/src/_includes/section-menu/contribute.html | 2 + website/src/contribute/jira-priorities.md | 76 ++++++ website/src/contribute/release-blocking.md | 41 +++ 95 files changed, 3499 insertions(+), 619 deletions(-) create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/schemas/SchemaCoderTest.java create mode 100644 sdks/java/io/rabbitmq/src/test/java/org/apache/beam/sdk/io/rabbitmq/ExchangeTestPlan.java create mode 100644 sdks/java/io/rabbitmq/src/test/java/org/apache/beam/sdk/io/rabbitmq/RabbitMqTestUtils.java create mode 100644 sdks/java/io/rabbitmq/src/test/resources/org/apache/beam/sdk/io/rabbitmq/rabbitmq-io-test-config.json create mode 100644 sdks/python/apache_beam/examples/snippets/transforms/aggregation/combineperkey.py create mode 100644 sdks/python/apache_beam/examples/snippets/transforms/aggregation/combineperkey_test.py copy sdks/python/apache_beam/examples/snippets/transforms/{elementwise/keys.py => aggregation/distinct.py} (75%) copy sdks/python/apache_beam/examples/snippets/transforms/{elementwise/keys_test.py => aggregation/distinct_test.py} (78%) delete mode 100644 sdks/python/apache_beam/io/gcp/datastore/v1new/helper_test.py create mode 100644 sdks/python/apache_beam/runners/interactive/display/pcoll_visualization.py create mode 100644 sdks/python/apache_beam/runners/interactive/display/pcoll_visualization_test.py copy sdks/python/{apache_beam/coders/avro_record.py => conftest.py} (67%) copy sdks/python/{apache_beam/metrics/execution.pxd => pytest.ini} (63%) create mode 100755 sdks/python/scripts/run_pytest.sh create mode 100644 website/src/contribute/jira-priorities.md create mode 100644 website/src/contribute/release-blocking.md