See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/4149/display/redirect>
Changes: ------------------------------------------ [...truncated 78.55 KB...] Using cached google_crc32c-1.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (32 kB) Collecting grpcio-status>=1.16.0 Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB) Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB) Collecting isodate>=0.6.0 Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB) Collecting requests-oauthlib>=0.5.0 Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB) Collecting pyasn1>=0.1.7 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.44.0.dev0) (1.11.0) Collecting oauthlib>=3.0.0 Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB) Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.44.0.dev0-py3-none-any.whl size=2919418 sha256=64a2183eef3a0a6099da9596a54b0026fe8aa2bd3cf7597b6c5a92ee92386540 Stored in directory: /home/jenkins/.cache/pip/wheels/4d/10/70/a4f31021d1b209ed2c064cb020c99c8e61a2909f0099842331 Successfully built apache-beam Installing collected packages: sortedcontainers, pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, sqlparse, scipy, rsa, regex, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, pyarrow, psycopg2-binary, proto-plus, pbr, overrides, orjson, objsize, oauthlib, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, exceptiongroup, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scikit-learn, requests, pytest, pandas, oauth2client, mock, hypothesis, grpcio-status, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, azure-storage-blob, google-cloud-pubsublite, google-cloud-bigquery > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 >>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.44.0-SNAPSHOT.jar> >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --experiments=beam_fn_api >>> pytest options: --capture=no --timeout=4500 --color=yes >>> --log-cli-level=INFO --numprocesses=8 >>> collect markers: -m=it_validatesrunner and not no_sickbay_batch [1m============================= test session starts ==============================[0m platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> configfile: pytest.ini plugins: hypothesis-6.56.4, xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [1m[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0mgw0 [36] / gw1 [36] / gw2 [36] / gw3 [36] / gw4 [36] / gw5 [36] / gw6 [36] / gw7 [36] scheduling tests via LoadScheduling apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine [gw5] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest [gw5] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections > Task :sdks:python:test-suites:dataflow:py310:installGcpTest Successfully installed apache-beam-2.44.0.dev0 attrs-22.1.0 azure-core-1.26.1 azure-storage-blob-12.14.1 boto3-1.26.6 botocore-1.29.6 cachetools-4.2.4 certifi-2022.9.24 cffi-1.15.1 charset-normalizer-2.1.1 cloudpickle-2.2.0 crcmod-1.7 cryptography-38.0.3 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.0.1 execnet-1.9.0 fastavro-1.7.0 fasteners-0.18 freezegun-1.2.2 google-api-core-2.10.2 google-apitools-0.5.31 google-auth-2.14.1 google-auth-httplib2-0.1.0 google-cloud-bigquery-3.3.6 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-2.3.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.9.2 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.10 google-cloud-pubsublite-1.6.0 google-cloud-recommendations-ai-0.7.1 google-cloud-spanner-3.23.0 google-cloud-videointelligence-1.16.3 google-cloud-vision-3.1.4 google-crc32c-1.5.0 google-resumable-media-2.4.0 googleapis-common-protos-1.56.4 greenlet-2.0.1 grpc-google-iam-v1-0.12.4 grpcio-status-1.48.2 hdfs-2.7.0 httplib2-0.20.4 hypothesis-6.56.4 idna-3.4 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.2.0 mock-2.0.0 msrest-0.7.1 oauth2client-4.1.3 oauthlib-3.2.2 objsize-0.5.2 orjson-3.8.1 overrides-6.5.0 pandas-1.4.4 parameterized-0.8.1 pbr-5.11.0 proto-plus-1.22.1 psycopg2-binary-2.9.5 pyarrow-9.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pytest-7.2.0 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.6 pyyaml-6.0 regex-2022.10.31 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.10.0 rsa-4.9 s3transfer-0.6.0 scikit-learn-1.1.3 scipy-1.9.3 sortedcontainers-2.4.0 sqlalchemy-1.4.43 sqlparse-0.4.3 tenacity-5.1.5 testcontainers-3.7.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.12 websocket-client-1.4.2 wrapt-1.14.1 zstandard-0.19.0 > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerBatchTests >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 >>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.44.0-SNAPSHOT.jar> >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --experiments=beam_fn_api >>> pytest options: --capture=no --timeout=4500 --color=yes >>> --log-cli-level=INFO --numprocesses=8 >>> collect markers: -m=it_validatesrunner and not no_sickbay_batch [1m============================= test session starts ==============================[0m platform linux -- Python 3.10.2, pytest-7.2.0, pluggy-1.0.0 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> configfile: pytest.ini plugins: hypothesis-6.56.4, xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [1m[gw0] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw2] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw1] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw3] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw7] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw4] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw5] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw6] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0mgw0 [36] / gw1 [36] / gw2 [36] / gw3 [36] / gw4 [36] / gw5 [36] / gw6 [36] / gw7 [36] scheduling tests via LoadScheduling apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key [gw3] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest [gw3] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests [gw4] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers [gw3] [32mPASSED[0m apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest [gw3] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest apache_beam/transforms/ptransform_test.py::PTransformTest::test_multiple_empty_outputs > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerBatchTests [gw0] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state [gw0] [33mSKIPPED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests [gw6] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection [gw2] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerBatchTests [gw1] [32mPASSED[0m apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest [gw1] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests [gw7] [32mPASSED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection [gw5] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_same_pcollections [gw0] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine [gw1] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state [gw1] [33mSKIPPED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_twice > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerBatchTests [gw2] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine [gw3] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_same_pcollections [gw6] [32mPASSED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection [gw7] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle [gw5] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers [gw4] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests [gw6] node down: Not properly terminated [gw6] [31mFAILED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection replacing crashed worker gw6 [1m[gw8] linux Python 3.7.12 cwd: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python> [0m[1m[gw8] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[gw5] node down: Not properly terminated [gw5] [31mFAILED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_same_pcollections Terminated Traceback (most recent call last): File "<string>", line 1, in <module> > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests FAILED > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerBatchTests [gw5] node down: Not properly terminated [gw5] [31mFAILED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers Terminated Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:231) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerBatchTests FAILED > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerStreamingTests > FAILED Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:231) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:370) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:87) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerStreamingTests >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 --streaming >>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.44.0-SNAPSHOT.jar> >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --enable_streaming_engine >>> pytest options: --capture=no --timeout=4500 --color=yes >>> --log-cli-level=INFO --numprocesses=8 >>> collect markers: -m=it_validatesrunner and not no_sickbay_streaming and >>> not no_xdist Daemon will be stopped at the end of the build after the daemon was no longer found in the daemon registry The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=865af464-7a1b-4fab-b01f-4f72207c1079, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 3394249 log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-3394249.out.log ----- Last 20 lines from daemon log file - daemon-3394249.out.log ----- at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Daemon will be stopped at the end of the build after the daemon was no longer found in the daemon registry Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:231) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
