See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11260/display/redirect>
Changes:
------------------------------------------
[...truncated 134.58 KB...]
✓ 0.14s
Running before_build...
+ sh -c 'pip install cython==0.29.36 numpy && pip install --upgrade
setuptools'
WARNING: Running pip as the 'root' user can result in broken permissions and
conflicting behaviour with the system package manager. It is recommended to use
a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip available: 22.2.2 -> 23.2.1
[notice] To update, run: python -m pip install --upgrade pip
WARNING: Running pip as the 'root' user can result in broken permissions and
conflicting behaviour with the system package manager. It is recommended to use
a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip available: 22.2.2 -> 23.2.1
[notice] To update, run: python -m pip install --upgrade pip
Collecting cython==0.29.36
Downloading
Cython-0.29.36-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl
(1.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.9/1.9 MB 21.5 MB/s eta 0:00:00
Collecting numpy
Downloading
numpy-1.24.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 42.9 MB/s eta 0:00:00
Installing collected packages: numpy, cython
Successfully installed cython-0.29.36 numpy-1.24.4
Requirement already satisfied: setuptools in
/opt/_internal/cpython-3.8.13/lib/python3.8/site-packages (63.4.2)
Collecting setuptools
Downloading setuptools-68.1.2-py3-none-any.whl (805 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 805.1/805.1 kB 14.8 MB/s eta 0:00:00
Installing collected packages: setuptools
Attempting uninstall: setuptools
Found existing installation: setuptools 63.4.2
Uninstalling setuptools-63.4.2:
Successfully uninstalled setuptools-63.4.2
Successfully installed setuptools-68.1.2
✓ 13.49s
Building wheel...
+ rm -rf /tmp/cibuildwheel/built_wheel
+ mkdir -p /tmp/cibuildwheel/built_wheel
+ python -m pip wheel /project --wheel-dir=/tmp/cibuildwheel/built_wheel
--no-deps
> Task :sdks:python:test-suites:dataflow:py311:validatesRunnerBatchTests
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/apache_beam-2.51.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl>
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes
>>> --log-cli-level=INFO --numprocesses=8
>>> collect markers: -m=it_validatesrunner and not no_sickbay_batch
[1m============================= test session starts
==============================[0m
platform linux -- Python 3.11.2, pytest-7.4.1, pluggy-1.3.0
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python>
configfile: pytest.ini
plugins: xdist-3.3.1, requests-mock-1.11.0, timeout-2.1.0, hypothesis-6.84.1
timeout: 4500.0s
timeout method: signal
timeout func_only: False
created: 8/8 workers
8 workers [38 items]
scheduling tests via LoadScheduling
apache_beam/pipeline_test.py::DoFnTest::test_element_param
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine
apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit
apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle
apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo
[gw2] [32mPASSED[0m
apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally
[gw6] [32mPASSED[0m
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest
[gw6] [32mPASSED[0m
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection
> Task :sdks:python:bdistPy38linux
[notice] A new release of pip available: 22.2.2 -> 23.2.1
[notice] To update, run: pip install --upgrade pip
Processing /project
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): still running...
Building wheel for apache-beam (setup.py): still running...
Building wheel for apache-beam (setup.py): still running...
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam:
filename=apache_beam-2.51.0.dev0-cp38-cp38-linux_x86_64.whl size=15360678
sha256=772c39cfe19216cd73e18c05df4197b8abd321600fec907e16adaff81d0e7637
Stored in directory:
/tmp/pip-ephem-wheel-cache-csh7agsj/wheels/d4/3a/c0/4dc152b1840724d5b992a8268bb4ef33fdbe42ffe1429b845c
Successfully built apache-beam
+ /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob;
json.dump(glob.glob('"'"'/tmp/cibuildwheel/built_wheel/*.whl'"'"'), sys.stdout)'
+ rm -rf /tmp/cibuildwheel/repaired_wheel
+ mkdir -p /tmp/cibuildwheel/repaired_wheel
✓ 226.06s
Repairing wheel...
+ sh -c 'auditwheel repair -w /tmp/cibuildwheel/repaired_wheel
/tmp/cibuildwheel/built_wheel/apache_beam-2.51.0.dev0-cp38-cp38-linux_x86_64.whl'
INFO:auditwheel.main_repair:Repairing
apache_beam-2.51.0.dev0-cp38-cp38-linux_x86_64.whl
INFO:auditwheel.wheeltools:Previous filename tags: linux_x86_64
INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_x86_64,
manylinux2014_x86_64
INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp38-cp38-linux_x86_64
INFO:auditwheel.wheeltools:New WHEEL info tags:
cp38-cp38-manylinux_2_17_x86_64, cp38-cp38-manylinux2014_x86_64
INFO:auditwheel.main_repair:
Fixed-up wheel written to
/tmp/cibuildwheel/repaired_wheel/apache_beam-2.51.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
+ /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob;
json.dump(glob.glob('"'"'/tmp/cibuildwheel/repaired_wheel/*.whl'"'"'),
sys.stdout)'
+ mkdir -p /output
+ mv
/tmp/cibuildwheel/repaired_wheel/apache_beam-2.51.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
/output
✓ 6.29s
✓ cp38-manylinux_x86_64 finished in 246.12s
Copying wheels back to host...
✓ 0.15s
1 wheels produced in 4 minutes:
apache_beam-2.51.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
15,017 kB
> Task :sdks:python:test-suites:dataflow:py38:initializeForDataflowJob
> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/apache_beam-2.51.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl>
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes
>>> --log-cli-level=INFO --numprocesses=8
>>> collect markers: -m=it_validatesrunner and not no_sickbay_batch
[1m============================= test session starts
==============================[0m
platform linux -- Python 3.8.10, pytest-7.4.1, pluggy-1.3.0
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python>
configfile: pytest.ini
plugins: xdist-3.3.1, requests-mock-1.11.0, timeout-2.1.0, hypothesis-6.84.1
timeout: 4500.0s
timeout method: signal
timeout func_only: False
created: 8/8 workers
8 workers [38 items]
scheduling tests via LoadScheduling
apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest
apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values
apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine
apache_beam/pipeline_test.py::DoFnTest::test_element_param
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit
[gw2] [32mPASSED[0m
apache_beam/runners/portability/fn_api_runner/fn_runner_test.py::FnApiBasedStateBackedCoderTest::test_gbk_many_values
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally
[gw6] [32mPASSED[0m
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_earliest
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest
[gw6] [32mPASSED[0m
apache_beam/transforms/combiners_test.py::TimestampCombinerTest::test_combiner_latest
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection
> Task :sdks:python:test-suites:dataflow:py311:validatesRunnerBatchTests
[gw1] [32mPASSED[0m
apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo
apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
[gw1] [33mSKIPPED[0m
apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_same_pcollections
[gw6] [32mPASSED[0m
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections
[gw3] [32mPASSED[0m
apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection
[gw0] [32mPASSED[0m
apache_beam/pipeline_test.py::DoFnTest::test_element_param
apache_beam/pipeline_test.py::DoFnTest::test_key_param
[gw2] [32mPASSED[0m
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers
[gw4] [32mPASSED[0m
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key
[gw5] [32mPASSED[0m
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state
[gw5] [33mSKIPPED[0m
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state
apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice
[gw7] [32mPASSED[0m
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine
apache_beam/transforms/combiners_test.py::CombineValuesTest::test_gbk_immediately_followed_by_combine
> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests
[gw7] [32mPASSED[0m
apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection
[gw0] [32mPASSED[0m
apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo
apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
[gw0] [33mSKIPPED[0m
apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
apache_beam/transforms/ptransform_test.py::PTransformTest::test_impulse
[gw6] [32mPASSED[0m
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections
[gw4] [32mPASSED[0m
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combine
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state
[gw4] [33mSKIPPED[0m
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_combining_value_state
apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_yield
[gw1] [32mPASSED[0m
apache_beam/pipeline_test.py::DoFnTest::test_element_param
apache_beam/pipeline_test.py::DoFnTest::test_key_param
[gw2] [32mPASSED[0m
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_globally
apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers
[gw3] [32mPASSED[0m
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit
apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_per_key
[gw5] [32mPASSED[0m
apache_beam/transforms/combinefn_lifecycle_test.py::CombineFnLifecycleTest::test_non_liftable_combine
apache_beam/transforms/combiners_test.py::CombineValuesTest::test_gbk_immediately_followed_by_combine
Build timed out (after 200 minutes). Marking the build as aborted.
FATAL: command execution failed
hudson.remoting.ChannelClosedException: Channel
"hudson.remoting.Channel@389ea808:apache-beam-jenkins-2": Remote call on
apache-beam-jenkins-2 failed. The channel is closing down or has closed down
at hudson.remoting.Channel.call(Channel.java:993)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy138.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:321)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: java.io.IOException
at hudson.remoting.Channel.close(Channel.java:1470)
at hudson.remoting.Channel.close(Channel.java:1447)
at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:902)
at hudson.slaves.SlaveComputer.access$100(SlaveComputer.java:111)
at hudson.slaves.SlaveComputer$2.run(SlaveComputer.java:782)
at
jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at
jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:68)
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
FATAL: Channel "hudson.remoting.Channel@389ea808:apache-beam-jenkins-2": Remote
call on apache-beam-jenkins-2 failed. The channel is closing down or has closed
down
java.io.IOException
at hudson.remoting.Channel.close(Channel.java:1470)
at hudson.remoting.Channel.close(Channel.java:1447)
at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:902)
at hudson.slaves.SlaveComputer.access$100(SlaveComputer.java:111)
at hudson.slaves.SlaveComputer$2.run(SlaveComputer.java:782)
at
jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at
jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:68)
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused: hudson.remoting.ChannelClosedException: Channel
"hudson.remoting.Channel@389ea808:apache-beam-jenkins-2": Remote call on
apache-beam-jenkins-2 failed. The channel is closing down or has closed down
at hudson.remoting.Channel.call(Channel.java:993)
at hudson.Launcher$RemoteLauncher.kill(Launcher.java:1150)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
