See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/4099/display/redirect?page=changes>
Changes: [bulat.safiullin] [Website] update calendar section mobile classes #22694 [Robert Bradshaw] More bigquery native sink cleanup. [noreply] adding examples in schema transforms section of programming guide for ------------------------------------------ [...truncated 78.31 KB...] Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB) Collecting pycparser Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting websocket-client>=0.32.0 Using cached websocket_client-1.4.1-py3-none-any.whl (55 kB) Collecting googleapis-common-protos<2.0dev,>=1.56.2 Using cached googleapis_common_protos-1.56.4-py2.py3-none-any.whl (211 kB) Collecting google-crc32c<2.0dev,>=1.0 Using cached google_crc32c-1.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (32 kB) Collecting grpcio-status>=1.16.0 Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB) Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB) Collecting requests-oauthlib>=0.5.0 Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB) Collecting isodate>=0.6.0 Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB) Collecting pyasn1>=0.1.7 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.44.0.dev0) (1.11.0) Collecting oauthlib>=3.0.0 Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB) Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.44.0.dev0-py3-none-any.whl size=2904788 sha256=e315d07acf9837dc9dcba892094916ece79f00797d469706396f46508721752c Stored in directory: /home/jenkins/.cache/pip/wheels/4d/10/70/a4f31021d1b209ed2c064cb020c99c8e61a2909f0099842331 Successfully built apache-beam Installing collected packages: sortedcontainers, pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, sqlparse, scipy, rsa, regex, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, pyarrow, psycopg2-binary, proto-plus, pbr, overrides, orjson, objsize, oauthlib, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, exceptiongroup, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scikit-learn, requests, pytest, pandas, oauth2client, mock, hypothesis, grpcio-status, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, s3transfer, requests-oauthlib, requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3, apache-beam, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, azure-storage-blob, google-cloud-pubsublite, google-cloud-bigquery > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 >>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.44.0-SNAPSHOT.jar> >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --experiments=beam_fn_api >>> pytest options: --capture=no --timeout=4500 --color=yes >>> --log-cli-level=INFO --numprocesses=8 >>> collect markers: -m=it_validatesrunner and not no_sickbay_batch [1m============================= test session starts ==============================[0m platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> configfile: pytest.ini plugins: hypothesis-6.56.4, xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [1m[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0m[1m[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [0mgw0 [36] / gw1 [36] / gw2 [36] / gw3 [36] / gw4 [36] / gw5 [36] / gw6 [36] / gw7 [36] scheduling tests via LoadScheduling apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo [gw1] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest [gw1] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections > Task :sdks:python:test-suites:dataflow:py310:installGcpTest Successfully installed apache-beam-2.44.0.dev0 attrs-22.1.0 azure-core-1.26.0 azure-storage-blob-12.14.1 boto3-1.25.4 botocore-1.28.4 cachetools-4.2.4 certifi-2022.9.24 cffi-1.15.1 charset-normalizer-2.1.1 cloudpickle-2.2.0 crcmod-1.7 cryptography-38.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.0 docopt-0.6.2 exceptiongroup-1.0.0 execnet-1.9.0 fastavro-1.7.0 fasteners-0.18 freezegun-1.2.2 google-api-core-2.10.2 google-apitools-0.5.31 google-auth-2.13.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-3.3.5 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-2.3.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.9.2 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.10 google-cloud-pubsublite-1.6.0 google-cloud-recommendations-ai-0.7.1 google-cloud-spanner-3.22.2 google-cloud-videointelligence-1.16.3 google-cloud-vision-3.1.4 google-crc32c-1.5.0 google-resumable-media-2.4.0 googleapis-common-protos-1.56.4 greenlet-1.1.3.post0 grpc-google-iam-v1-0.12.4 grpcio-status-1.48.2 hdfs-2.7.0 httplib2-0.20.4 hypothesis-6.56.4 idna-3.4 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.2.0 mock-2.0.0 msrest-0.7.1 oauth2client-4.1.3 oauthlib-3.2.2 objsize-0.5.2 orjson-3.8.1 overrides-6.5.0 pandas-1.4.4 parameterized-0.8.1 pbr-5.11.0 proto-plus-1.22.1 psycopg2-binary-2.9.5 pyarrow-9.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.2.0 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.5 pyyaml-6.0 regex-2022.9.13 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.10.0 rsa-4.9 s3transfer-0.6.0 scikit-learn-1.1.3 scipy-1.9.3 sortedcontainers-2.4.0 sqlalchemy-1.4.42 sqlparse-0.4.3 tenacity-5.1.5 testcontainers-3.7.0 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.12 websocket-client-1.4.1 wrapt-1.14.1 zstandard-0.18.0 > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerBatchTests >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 >>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.44.0-SNAPSHOT.jar> >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --experiments=beam_fn_api >>> pytest options: --capture=no --timeout=4500 --color=yes >>> --log-cli-level=INFO --numprocesses=8 >>> collect markers: -m=it_validatesrunner and not no_sickbay_batch [1m============================= test session starts ==============================[0m platform linux -- Python 3.10.2, pytest-7.2.0, pluggy-1.0.0 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python,> configfile: pytest.ini plugins: hypothesis-6.56.4, xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [1m[gw1] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw0] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw3] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw2] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw4] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw5] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw6] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[1m[gw7] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0mgw0 [36] / gw1 [36] / gw2 [36] / gw3 [36] / gw4 [36] / gw5 [36] / gw6 [36] / gw7 [36] scheduling tests via LoadScheduling apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine [gw2] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest [gw2] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests [gw4] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle [gw7] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection [gw6] [32mPASSED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection [gw1] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_same_pcollections [gw2] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state [gw2] [33mSKIPPED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state apache_beam/transforms/ptransform_test.py::PTransformTest::test_read_metrics [gw0] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine [gw3] [32mPASSED[0m apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest [gw3] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_list_and_as_dict_side_inputs [gw5] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerBatchTests [gw2] [32mPASSED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_same_pcollections [gw0] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_key_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine [gw1] [32mPASSED[0m apache_beam/pipeline_test.py::DoFnTest::test_element_param apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state [gw1] [33mSKIPPED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return [gw4] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle [gw7] [32mPASSED[0m apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection [gw3] [32mPASSED[0m apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest [gw3] [32mPASSED[0m apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice [gw6] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers [gw5] [32mPASSED[0m apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection [gw6] node down: Not properly terminated [gw6] [31mFAILED[0m apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers replacing crashed worker gw6 [1m[gw8] linux Python 3.10.2 cwd: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python> [0m[1m[gw8] Python 3.10.2 (main, Jan 15 2022, 18:02:07) [GCC 9.3.0] [0m[gw3] node down: Not properly terminated [gw3] [31mFAILED[0m apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice Terminated Traceback (most recent call last): File "<string>", line 1, in <module> > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerBatchTests FAILED > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests [gw4] node down: Not properly terminated [gw4] [31mFAILED[0m apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle Terminated Traceback (most recent call last): File "<string>", line 1, in <module> > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerBatchTests FAILED > Task :sdks:python:test-suites:dataflow:py37:validatesRunnerStreamingTests > FAILED Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:370) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:87) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:38) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) > Task :sdks:python:test-suites:dataflow:py310:validatesRunnerStreamingTests >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz> >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 --streaming >>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.44.0-SNAPSHOT.jar> >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --enable_streaming_engine >>> pytest options: --capture=no --timeout=4500 --color=yes >>> --log-cli-level=INFO --numprocesses=8 >>> collect markers: -m=it_validatesrunner and not no_sickbay_streaming and >>> not no_xdist Daemon will be stopped at the end of the build after the daemon was no longer found in the daemon registry The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=0c2b1576-d23d-4c3c-a7d0-86f6d68172a1, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 3529215 log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-3529215.out.log ----- Last 20 lines from daemon log file - daemon-3529215.out.log ----- at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Daemon will be stopped at the end of the build after the daemon was no longer found in the daemon registry Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
