See
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/1143/display/redirect>
Changes:
------------------------------------------
[...truncated 221.71 KB...]
✓ 9.38s
Copying project into container...
+ mkdir -p /project
✓ 0.46s
Building cp38-manylinux_x86_64 wheel
CPython 3.8 manylinux x86_64
Setting up build environment...
+ /opt/python/cp38-cp38/bin/python -c 'import sys, json, os;
json.dump(os.environ.copy(), sys.stdout)'
+ which python
+ which pip
✓ 0.24s
Building wheel...
+ rm -rf /tmp/cibuildwheel/built_wheel
+ mkdir -p /tmp/cibuildwheel/built_wheel
+ python -m pip wheel /project --wheel-dir=/tmp/cibuildwheel/built_wheel
--no-deps
> Task :sdks:python:test-suites:dataflow:py38:installGcpTest
Successfully installed PyJWT-2.8.0 apache-beam-2.52.0.dev0 attrs-23.1.0
azure-core-1.29.4 azure-identity-1.15.0b2 azure-storage-blob-12.18.3
backports.zoneinfo-0.2.1 boto3-1.28.64 botocore-1.31.64 certifi-2023.7.22
cffi-1.16.0 charset-normalizer-3.3.0 cloudpickle-2.2.1 crcmod-1.7
cryptography-41.0.4 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3
docopt-0.6.2 exceptiongroup-1.1.3 execnet-2.0.2 fastavro-1.8.4 fasteners-0.19
freezegun-1.2.2 google-api-core-2.12.0 google-apitools-0.5.31
google-auth-2.23.3 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.35.0
google-cloud-bigquery-3.12.0 google-cloud-bigquery-storage-2.22.0
google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3
google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.3
google-cloud-language-2.11.1 google-cloud-pubsub-2.18.4
google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.5
google-cloud-resource-manager-1.10.4 google-cloud-spanner-3.40.1
google-cloud-storage-2.12.0 google-cloud-videointelligence-2.11.4
google-cloud-vision-3.4.4 google-crc32c-1.5.0 google-resumable-media-2.6.0
googleapis-common-protos-1.61.0 greenlet-3.0.0 grpc-google-iam-v1-0.12.6
grpcio-1.59.0 grpcio-status-1.59.0 hdfs-2.7.3 httplib2-0.22.0 hypothesis-6.88.1
idna-3.4 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74
mock-5.1.0 msal-1.24.1 msal-extensions-1.0.0 numpy-1.24.4 oauth2client-4.1.3
objsize-0.6.1 orjson-3.9.9 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0
portalocker-2.8.2 proto-plus-1.22.3 protobuf-4.24.4 psycopg2-binary-2.9.9
pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2
pyhamcrest-2.0.4 pyjsparser-2.7.1 pymongo-4.5.0 pymysql-1.1.0 pyparsing-3.1.1
pytest-7.4.2 pytest-timeout-2.2.0 pytest-xdist-3.3.1 python-dateutil-2.8.2
pytz-2023.3.post1 pyyaml-6.0.1 regex-2023.10.3 requests-2.31.0
requests-mock-1.11.0 rsa-4.9 s3transfer-0.7.0 scikit-learn-1.3.1 scipy-1.10.1
shapely-2.0.2 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.49
sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0
typing-extensions-4.8.0 tzlocal-5.1 urllib3-1.26.17 websocket-client-1.6.4
wrapt-1.16.0rc1 zstandard-0.21.0
WARNING: There was an error checking the latest version of pip.
> Task :sdks:python:test-suites:dataflow:py311:preCommitIT_batch
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/build/apache_beam-2.52.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl>
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options:
>>> apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
>>> --capture=no --numprocesses=2 --timeout=1800
>>> collect markers:
============================= test session starts ==============================
platform linux -- Python 3.11.2, pytest-7.4.2, pluggy-1.3.0
rootdir:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python>
configfile: pytest.ini
plugins: timeout-2.2.0, xdist-3.3.1, requests-mock-1.11.0, hypothesis-6.88.1
timeout: 1800.0s
timeout method: signal
timeout func_only: False
created: 2/2 workers
2 workers [1 item]
scheduling tests via LoadScheduling
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
> Task :sdks:python:bdistPy38linux
[notice] A new release of pip available: 22.2.2 -> 23.3
[notice] To update, run: pip install --upgrade pip
Processing /project
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (pyproject.toml): started
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): finished with status 'done'
Created wheel for apache-beam:
filename=apache_beam-2.52.0.dev0-cp38-cp38-linux_x86_64.whl size=15396728
sha256=4f3cb263d87b09ba5f59e17f8f6933e481eeb4da1c53fbbf1890c5eb1a7dd671
Stored in directory:
/tmp/pip-ephem-wheel-cache-kp57un7o/wheels/d4/3a/c0/4dc152b1840724d5b992a8268bb4ef33fdbe42ffe1429b845c
Successfully built apache-beam
+ /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob;
json.dump(glob.glob('"'"'/tmp/cibuildwheel/built_wheel/*.whl'"'"'), sys.stdout)'
+ rm -rf /tmp/cibuildwheel/repaired_wheel
+ mkdir -p /tmp/cibuildwheel/repaired_wheel
✓ 272.08s
Repairing wheel...
+ sh -c 'auditwheel repair -w /tmp/cibuildwheel/repaired_wheel
/tmp/cibuildwheel/built_wheel/apache_beam-2.52.0.dev0-cp38-cp38-linux_x86_64.whl'
INFO:auditwheel.main_repair:Repairing
apache_beam-2.52.0.dev0-cp38-cp38-linux_x86_64.whl
INFO:auditwheel.wheeltools:Previous filename tags: linux_x86_64
INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_x86_64,
manylinux2014_x86_64
INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp38-cp38-linux_x86_64
INFO:auditwheel.wheeltools:New WHEEL info tags:
cp38-cp38-manylinux_2_17_x86_64, cp38-cp38-manylinux2014_x86_64
INFO:auditwheel.main_repair:
Fixed-up wheel written to
/tmp/cibuildwheel/repaired_wheel/apache_beam-2.52.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
+ /opt/python/cp38-cp38/bin/python -c 'import sys, json, glob;
json.dump(glob.glob('"'"'/tmp/cibuildwheel/repaired_wheel/*.whl'"'"'),
sys.stdout)'
+ mkdir -p /output
+ mv
/tmp/cibuildwheel/repaired_wheel/apache_beam-2.52.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
/output
✓ 7.12s
✓ cp38-manylinux_x86_64 finished in 279.60s
Copying wheels back to host...
✓ 0.14s
1 wheels produced in 5 minutes:
apache_beam-2.52.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
15,053 kB
> Task :sdks:python:test-suites:dataflow:py38:initializeForDataflowJob
> Task :sdks:python:test-suites:dataflow:py38:preCommitIT_batch
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/build/apache_beam-2.52.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl>
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options:
>>> apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
>>> --capture=no --numprocesses=2 --timeout=1800
>>> collect markers:
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.4.2, pluggy-1.3.0
rootdir:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python>
configfile: pytest.ini
plugins: timeout-2.2.0, xdist-3.3.1, requests-mock-1.11.0, hypothesis-6.88.1
timeout: 1800.0s
timeout method: signal
timeout func_only: False
created: 2/2 workers
2 workers [1 item]
scheduling tests via LoadScheduling
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
> Task :sdks:python:test-suites:dataflow:py311:preCommitIT_batch
[gw1] PASSED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
- generated xml file:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/pytest_preCommitIT-df-py311.xml>
-
======================== 1 passed in 498.55s (0:08:18) =========================
> Task :sdks:python:test-suites:dataflow:py311:preCommitIT_streaming
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/build/apache_beam-2.52.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl>
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20 --streaming
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options:
>>> apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
>>> --capture=no --numprocesses=2 --timeout=1800
>>> collect markers:
============================= test session starts ==============================
platform linux -- Python 3.11.2, pytest-7.4.2, pluggy-1.3.0
rootdir:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python>
configfile: pytest.ini
plugins: timeout-2.2.0, xdist-3.3.1, requests-mock-1.11.0, hypothesis-6.88.1
timeout: 1800.0s
timeout method: signal
timeout func_only: False
created: 2/2 workers
2 workers [1 item]
scheduling tests via LoadScheduling
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
> Task :sdks:python:test-suites:dataflow:py38:preCommitIT_batch
[gw0] PASSED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it
- generated xml file:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/pytest_preCommitIT-df-py38.xml>
-
======================== 1 passed in 411.45s (0:06:51) =========================
> Task :sdks:python:test-suites:dataflow:py38:preCommitIT_streaming
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/build/apache_beam-2.52.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl>
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20 --streaming
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options:
>>> apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
>>> --capture=no --numprocesses=2 --timeout=1800
>>> collect markers:
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.4.2, pluggy-1.3.0
rootdir:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python>
configfile: pytest.ini
plugins: timeout-2.2.0, xdist-3.3.1, requests-mock-1.11.0, hypothesis-6.88.1
timeout: 1800.0s
timeout method: signal
timeout func_only: False
created: 2/2 workers
2 workers [1 item]
scheduling tests via LoadScheduling
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
[gw1] FAILED
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/junitxml.py";,>
line 683, in pytest_sessionfinish
logfile.write(ET.tostring(testsuites, encoding="unicode"))
OSError: [Errno 28] No space left on device
During handling of the above exception, another exception occurred:
OSError: [Errno 28] No space left on device
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/bin/pytest";,>
line 8, in <module>
sys.exit(console_main())
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/config/__init__.py";,>
line 192, in console_main
code = main()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/config/__init__.py";,>
line 169, in main
ret: Union[ExitCode, int] = config.hook.pytest_cmdline_main(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pluggy/_hooks.py";,>
line 493, in __call__
return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pluggy/_manager.py";,>
line 115, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pluggy/_callers.py";,>
line 113, in _multicall
raise exception.with_traceback(exception.__traceback__)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pluggy/_callers.py";,>
line 77, in _multicall
res = hook_impl.function(*args)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/main.py";,>
line 318, in pytest_cmdline_main
return wrap_session(config, _main)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/main.py";,>
line 306, in wrap_session
config.hook.pytest_sessionfinish(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pluggy/_hooks.py";,>
line 493, in __call__
return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pluggy/_manager.py";,>
line 115, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pluggy/_callers.py";,>
line 130, in _multicall
teardown[0].send(outcome)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/terminal.py";,>
line 857, in pytest_sessionfinish
outcome.get_result()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pluggy/_result.py";,>
line 114, in get_result
raise exc.with_traceback(exc.__traceback__)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pluggy/_callers.py";,>
line 77, in _multicall
res = hook_impl.function(*args)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/_pytest/junitxml.py";,>
line 683, in pytest_sessionfinish
logfile.write(ET.tostring(testsuites, encoding="unicode"))
OSError: [Errno 28] No space left on device
> Task :sdks:python:test-suites:dataflow:py38:preCommitIT_streaming FAILED
> Task :sdks:python:test-suites:dataflow:py311:preCommitIT_streaming
[gw0] PASSED
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
- generated xml file:
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/pytest_preCommitIT-df-py311.xml>
-
======================== 1 passed in 906.07s (0:15:06) =========================
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PreCommit_Python_Integration_Cron/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 111
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py38:preCommitIT_streaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
For more on this, please refer to
https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings
in the Gradle documentation.
BUILD FAILED in 29m 21s
18 actionable tasks: 17 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/6dfc7vjwwfjno
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
