See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2824/display/redirect?page=changes>
Changes: [aydar.zaynutdinov] [BEAM-13424][Playground] [aydar.zaynutdinov] [BEAM-13424][Playground] [stranniknm] [BEAM-13426] clear log and output panels on example change [aydar.zaynutdinov] [BEAM-13428][Playground] [aydar.zaynutdinov] [BEAM-13424][Playground] [daria.malkova] add type of precompiled object [Alexey Romanenko] [BEAM-13171] Fix Duration ambiguity [mmack] [BEAM-13410][BEAM-11788] Integration test for S3Filesystem using [Alexey Romanenko] [BEAM-13434] Bump up Apache log4j2 vulnerability to 2.15.0 [noreply] Merge pull request #16138 from [BEAM-13343][Playground] Support go unit [noreply] [BEAM-12560] Dataframe idxmin and idxmax implementation (#15827) ------------------------------------------ [...truncated 70.21 KB...] [33m=============================== warnings summary ===============================[0m apache_beam/io/filesystems_test.py:54 apache_beam/io/filesystems_test.py:54 apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 apache_beam/io/filesystems_test.py:62 apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerBatchTests-df-py38.xml> - [33m[1m============= 35 passed, 1 skipped, 14 warnings in 2710.51 seconds =============[0m > Task :sdks:python:test-suites:dataflow:validatesRunnerBatchTestsV2 > Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 --streaming >>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.36.0-SNAPSHOT.jar> >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --enable_streaming_engine >>> pytest options: --capture=no --timeout=4500 --color=yes >>> --log-cli-level=INFO --numprocesses=8 >>> collect markers: -m=it_validatesrunner and not no_sickbay_streaming and >>> not no_xdist [1m============================= test session starts ==============================[0m platform linux -- Python 3.8.9, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [1m[gw1] Python 3.8.9 (default, Apr 3 2021, 01:02:10) -- [GCC 5.4.0 20160609] [0m[1m[gw0] Python 3.8.9 (default, Apr 3 2021, 01:02:10) -- [GCC 5.4.0 20160609] [0m[1m[gw2] Python 3.8.9 (default, Apr 3 2021, 01:02:10) -- [GCC 5.4.0 20160609] [0m[1m[gw3] Python 3.8.9 (default, Apr 3 2021, 01:02:10) -- [GCC 5.4.0 20160609] [0m[1m[gw4] Python 3.8.9 (default, Apr 3 2021, 01:02:10) -- [GCC 5.4.0 20160609] [0m[1m[gw5] Python 3.8.9 (default, Apr 3 2021, 01:02:10) -- [GCC 5.4.0 20160609] [0m[1m[gw7] Python 3.8.9 (default, Apr 3 2021, 01:02:10) -- [GCC 5.4.0 20160609] [0m[1m[gw6] Python 3.8.9 (default, Apr 3 2021, 01:02:10) -- [GCC 5.4.0 20160609] [0mgw0 [33] / gw1 [33] / gw2 [33] / gw3 [33] / gw4 [33] / gw5 [33] / gw6 [33] / gw7 [33] scheduling tests via LoadScheduling apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key [gw3] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest [gw3] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections [gw2] [32mPASSED[0m apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest [gw2] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs [gw1] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state [gw1] [33mSKIPPED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_yield [gw3] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse [gw7] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers [gw5] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection [gw0] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine [gw4] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle [gw6] [32mPASSED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection [gw2] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return [gw7] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_and_as_dict_side_inputs [gw1] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_yield apache_beam/transforms/ptransform_test.py::PTransformTest::test_undeclared_outputs [gw3] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice [gw5] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_twice [gw4] [32mPASSED[0m apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_without_unique_labels [gw0] [32mPASSED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_with_different_defaults [gw6] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_default_value_singleton_side_input [gw7] [32mPASSED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_and_as_dict_side_inputs apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input [gw1] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_undeclared_outputs apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input [gw2] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_empty_singleton_side_input [gw3] [32mPASSED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_reiterable_side_input [gw5] [32mPASSED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_twice apache_beam/transforms/util_test.py::ReshuffleTest::test_reshuffle_preserves_timestamps [gw4] [32mPASSED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_without_unique_labels [gw0] [32mPASSED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_singleton_with_different_defaults [gw1] [31mFAILED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input [gw6] [32mPASSED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_default_value_singleton_side_input [gw7] [32mPASSED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input [gw2] [32mPASSED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_empty_singleton_side_input [gw3] [32mPASSED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_reiterable_side_input [gw5] [32mPASSED[0m apache_beam/transforms/util_test.py::ReshuffleTest::test_reshuffle_preserves_timestamps =================================== FAILURES =================================== [31m[1m___________________ SideInputsTest.test_iterable_side_input ____________________[0m [gw1] linux -- Python 3.8.9 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8> self = <apache_beam.transforms.sideinputs_test.SideInputsTest testMethod=test_iterable_side_input> [1m @pytest.mark.it_validatesrunner[0m [1m def test_iterable_side_input(self):[0m [1m pipeline = self.create_pipeline()[0m [1m pcol = pipeline | 'start' >> beam.Create([1, 2])[0m [1m side = pipeline | 'side' >> beam.Create([3, 4]) # 2 values in side input.[0m [1m result = pcol | 'compute' >> beam.FlatMap([0m [1m lambda x, s: [x * y for y in s], beam.pvalue.AsIter(side))[0m [1m assert_that(result, equal_to([3, 4, 6, 8]))[0m [1m> pipeline.run()[0m [1m[31mapache_beam/transforms/sideinputs_test.py[0m:193: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <apache_beam.testing.test_pipeline.TestPipeline object at 0x7f538823d970> test_runner_api = True [1m def run(self, test_runner_api=True):[0m [1m result = super().run([0m [1m test_runner_api=([0m [1m False if self.not_use_test_runner_api else test_runner_api))[0m [1m if self.blocking:[0m [1m state = result.wait_until_finish()[0m [1m> assert state in (PipelineState.DONE, PipelineState.CANCELLED), \[0m [1m "Pipeline execution failed."[0m [1m[31mE AssertionError: Pipeline execution failed.[0m [1m[31mE assert 'FAILED' in ('DONE', 'CANCELLED')[0m [1m[31mapache_beam/testing/test_pipeline.py[0m:117: AssertionError ------------------------------ Captured log call ------------------------------- [32mINFO [0m apache_beam.runners.portability.stager:stager.py:692 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpxo4cpvaj/tmp_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:'] [32mINFO [0m apache_beam.runners.portability.stager:stager.py:302 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz";> to staging location. [33mWARNING [0m root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter. [32mINFO [0m root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.36.0.dev [32mINFO [0m root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20211202 [32mINFO [0m root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20211202" for Docker environment [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/requirements.txt... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/requirements.txt in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/pbr-5.7.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/pbr-5.7.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/pbr-5.8.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/pbr-5.8.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/mock-2.0.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/mock-2.0.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/six-1.16.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/six-1.16.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/soupsieve-2.3.1.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/soupsieve-2.3.1.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/PyHamcrest-1.10.1.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/PyHamcrest-1.10.1.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/parameterized-0.7.5.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/parameterized-0.7.5.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/beautifulsoup4-4.10.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/beautifulsoup4-4.10.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/dataflow_python_sdk.tar... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/dataflow_python_sdk.tar in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/dataflow-worker.jar... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/dataflow-worker.jar in 5 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:648 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/pipeline.pb... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:664 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1210192342-057467.1639164222.057612/pipeline.pb in 0 seconds. [33mWARNING [0m apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20'] [33mWARNING [0m apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20'] [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:828 Create job: <Job clientRequestId: '20211210192342058644-6630' createTime: '2021-12-10T19:23:49.963591Z' currentStateTime: '1970-01-01T00:00:00Z' id: '2021-12-10_11_23_49-3493656889738316026' location: 'us-central1' name: 'beamapp-jenkins-1210192342-057467' projectId: 'apache-beam-testing' stageStates: [] startTime: '2021-12-10T19:23:49.963591Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)> [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:830 Created job with id: [2021-12-10_11_23_49-3493656889738316026] [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:831 Submitted job: 2021-12-10_11_23_49-3493656889738316026 [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:832 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-10_11_23_49-3493656889738316026?project=apache-beam-testing [33mWARNING [0m apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:63 Waiting indefinitely for streaming job. [33m=============================== warnings summary ===============================[0m <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> - [31m[1m======== 1 failed, 31 passed, 1 skipped, 8 warnings in 3114.24 seconds =========[0m > Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests > FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 226 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 39m 52s 84 actionable tasks: 54 executed, 30 from cache Publishing build scan... https://gradle.com/s/chz6nzjuntche Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
