See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/5702/display/redirect?page=changes>
Changes:
[noreply] Remove build status from PR (#16902)
------------------------------------------
[...truncated 45.21 KB...]
Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting packaging>=14
Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting six>=1.14.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting toml>=0.9.4
Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting filelock>=3.0.0
Using cached filelock-3.6.0-py3-none-any.whl (10.0 kB)
Collecting protobuf<4.0dev,>=3.5.0.post1
Using cached
protobuf-3.19.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1
MB)
Collecting grpcio>=1.37.0
Using cached
grpcio-1.44.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.3 MB)
Collecting pyparsing!=3.0.5,>=2.0.2
Using cached pyparsing-3.0.7-py3-none-any.whl (98 kB)
Collecting platformdirs<3,>=2
Using cached platformdirs-2.5.0-py3-none-any.whl (14 kB)
Installing collected packages: distlib, wheel, toml, six, setuptools,
pyparsing, py, protobuf, pluggy, platformdirs, filelock, virtualenv, packaging,
mypy-protobuf, grpcio, tox, grpcio-tools
Attempting uninstall: setuptools
Found existing installation: setuptools 58.1.0
Uninstalling setuptools-58.1.0:
Successfully uninstalled setuptools-58.1.0
Successfully installed distlib-0.3.1 filelock-3.6.0 grpcio-1.44.0
grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.3 platformdirs-2.5.0
pluggy-1.0.0 protobuf-3.19.4 py-1.11.0 pyparsing-3.0.7 setuptools-60.9.3
six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.13.1 wheel-0.37.1
> Task :sdks:python:test-suites:portable:py36:setupVirtualenv
Successfully installed distlib-0.3.1 filelock-3.4.1 grpcio-1.44.0
grpcio-tools-1.37.0 importlib-metadata-2.1.3 importlib-resources-5.4.0
mypy-protobuf-1.18 packaging-21.3 platformdirs-2.4.0 pluggy-1.0.0
protobuf-3.19.4 py-1.11.0 pyparsing-3.0.7 setuptools-59.6.0 six-1.16.0
toml-0.10.2 tox-3.20.1 virtualenv-20.13.1 wheel-0.37.1 zipp-3.6.0
> Task :sdks:python:sdist
Regenerating Python proto definitions (no output files).
Found protoc_gen_mypy at
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/bin/protoc-gen-mypy>
beam_interactive_api.proto:36:1: warning: Import
google/protobuf/timestamp.proto is unused.
Writing mypy to external_transforms_pb2.pyi
Writing mypy to beam_runner_api_pb2.pyi
Writing mypy to standard_window_fns_pb2.pyi
Writing mypy to metrics_pb2.pyi
Writing mypy to endpoints_pb2.pyi
Writing mypy to schema_pb2.pyi
Writing mypy to beam_artifact_api_pb2.pyi
Writing mypy to beam_expansion_api_pb2.pyi
Writing mypy to beam_job_api_pb2.pyi
Writing mypy to beam_provision_api_pb2.pyi
Writing mypy to beam_fn_api_pb2.pyi
Writing mypy to beam_interactive_api_pb2.pyi
Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py>
Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py>
Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py>
Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2_urns.py>
Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py>
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:505:
UserWarning: Normalizing '2.38.0.dev' to '2.38.0.dev0'
warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
> Task :sdks:python:test-suites:portable:py36:sparkCompatibilityMatrixLOOPBACK
[1mspark-runner-test create:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test>
[0m[1mspark-runner-test installdeps: -rbuild-requirements.txt
[0m[1mspark-runner-test inst:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[31mERROR: invocation failed (exit code -15), logfile:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/log/spark-runner-test-2.log>
[0m================================== log start
===================================
Processing ./target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7-cp36-cp36m-linux_x86_64.whl
Collecting orjson<4.0
Using cached orjson-3.6.1-cp36-cp36m-manylinux_2_24_x86_64.whl (233 kB)
Collecting dill<0.3.2,>=0.3.1.1
Using cached dill-0.3.1.1-py3-none-any.whl
Collecting cloudpickle<3,>=2.0.0
Using cached cloudpickle-2.0.0-py3-none-any.whl (25 kB)
Collecting fastavro<2,>=0.23.6
Using cached
fastavro-1.4.7-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3
MB)
Requirement already satisfied: grpcio<2,>=1.29.0 in
./target/.tox-spark-runner-test/spark-runner-test/lib/python3.6/site-packages
(from apache-beam==2.38.0.dev0) (1.44.0)
Collecting hdfs<3.0.0,>=2.1.0
Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2<0.20.0,>=0.8
Using cached httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting numpy<1.22.0,>=1.14.3
Using cached numpy-1.19.5-cp36-cp36m-manylinux2010_x86_64.whl (14.8 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached
pymongo-3.12.3-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (506
kB)
Collecting oauth2client<5,>=2.0.1
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Requirement already satisfied: protobuf<4,>=3.12.2 in
./target/.tox-spark-runner-test/spark-runner-test/lib/python3.6/site-packages
(from apache-beam==2.38.0.dev0) (3.19.4)
Collecting proto-plus<2,>=1.7.1
Using cached proto_plus-1.20.3-py3-none-any.whl (46 kB)
Collecting pyarrow<7.0.0,>=0.15.1
Using cached
pyarrow-6.0.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6
MB)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting pytz>=2018.3
Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting requests<3.0.0,>=2.24.0
Using cached requests-2.27.1-py2.py3-none-any.whl (63 kB)
Collecting typing-extensions>=3.7.0
Using cached typing_extensions-4.1.1-py3-none-any.whl (26 kB)
Collecting dataclasses
Using cached dataclasses-0.8-py3-none-any.whl (19 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting pandas<2.0.0
Using cached pandas-1.1.5-cp36-cp36m-manylinux1_x86_64.whl (9.5 MB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached
PyYAML-6.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(603 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting sqlalchemy<2.0,>=1.3
Using cached
SQLAlchemy-1.4.31-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached
psycopg2_binary-2.9.3-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(3.0 MB)
Collecting testcontainers[mysql]<4.0.0,>=3.0.3
Using cached testcontainers-3.4.2-py2.py3-none-any.whl (31 kB)
Collecting cryptography>=36.0.0
Using cached cryptography-36.0.1-cp36-abi3-manylinux_2_24_x86_64.whl (3.6 MB)
Collecting cffi>=1.12
Using cached
cffi-1.15.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (405 kB)
Requirement already satisfied: six>=1.5.2 in
./target/.tox-spark-runner-test/spark-runner-test/lib/python3.6/site-packages
(from grpcio<2,>=1.29.0->apache-beam==2.38.0.dev0) (1.16.0)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting pbr>=0.11
Using cached pbr-5.8.1-py2.py3-none-any.whl (113 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting rsa>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting pyasn1-modules>=0.0.5
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting importlib-metadata>=0.12
Using cached importlib_metadata-4.8.3-py3-none-any.whl (17 kB)
Collecting packaging
Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting py>=1.5.0
Using cached py-1.11.0-py2.py3-none-any.whl (98 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.8-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting greenlet!=0.4.17
Using cached
greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147
kB)
Collecting docker
Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting wrapt
Using cached
wrapt-1.13.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(78 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting zipp>=0.5
Using cached zipp-3.6.0-py3-none-any.whl (5.3 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.2.3-py3-none-any.whl (53 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam:
filename=apache_beam-2.38.0.dev0-py3-none-any.whl size=2675866
sha256=d7923e298010bf434ca9ec9a6ef0d61a160003eeb481cab8f6526392e59a8a49
Stored in directory:
/home/jenkins/.cache/pip/wheels/a8/e0/59/39618abeaf084bc11c142b5753b9da0c44995346c101b8e249
Successfully built apache-beam
Installing collected packages: zipp, typing-extensions, urllib3, pyparsing,
importlib-metadata, idna, charset-normalizer, certifi, websocket-client,
wcwidth, requests, pyasn1, py, pluggy, packaging, more-itertools, attrs,
atomicwrites, wrapt, rsa, pytest, pycparser, pyasn1-modules, numpy, httplib2,
greenlet, docopt, docker, deprecation, testcontainers, sqlalchemy, pytz,
python-dateutil, pytest-forked, pymysql, pymongo, pydot, pyarrow, proto-plus,
pbr, orjson, oauth2client, hdfs, fastavro, execnet, dill, dataclasses, crcmod,
cloudpickle, cffi, tenacity, requests-mock, pyyaml, pytest-xdist,
pytest-timeout, pyhamcrest, psycopg2-binary, parameterized, pandas, mock,
freezegun, cryptography, apache-beam
=================================== log end ====================================
___________________________________ summary ____________________________________
[31mERROR: spark-runner-test: InvocationError for command
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/bin/python>
target/.tox-spark-runner-test/spark-runner-test/bin/pip install --retries 10
--exists-action w
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'>
(exited with code -15 (SIGTERM)) (exited with code -15)
[0m
> Task :sdks:python:test-suites:portable:py36:sparkCompatibilityMatrixLOOPBACK
> FAILED
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=0405adbc-9eed-412a-8f89-566f38504329,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 748469
log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-748469.out.log
----- Last 20 lines from daemon log file - daemon-748469.out.log -----
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting zipp>=0.5
Using cached zipp-3.6.0-py3-none-any.whl (5.3 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.2.3-py3-none-any.whl (53 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam:
filename=apache_beam-2.38.0.dev0-py3-none-any.whl size=2675866
sha256=d7923e298010bf434ca9ec9a6ef0d61a160003eeb481cab8f6526392e59a8a49
Stored in directory:
/home/jenkins/.cache/pip/wheels/a8/e0/59/39618abeaf084bc11c142b5753b9da0c44995346c101b8e249
Successfully built apache-beam
Installing collected packages: zipp, typing-extensions, urllib3, pyparsing,
importlib-metadata, idna, charset-normalizer, certifi, websocket-client,
wcwidth, requests, pyasn1, py, pluggy, packaging, more-itertools, attrs,
atomicwrites, wrapt, rsa, pytest, pycparser, pyasn1-modules, numpy, httplib2,
greenlet, docopt, docker, deprecation, testcontainers, sqlalchemy, pytz,
python-dateutil, pytest-forked, pymysql, pymongo, pydot, pyarrow, proto-plus,
pbr, orjson, oauth2client, hdfs, fastavro, execnet, dill, dataclasses, crcmod,
cloudpickle, cffi, tenacity, requests-mock, pyyaml, pytest-xdist,
pytest-timeout, pyhamcrest, psycopg2-binary, parameterized, pandas, mock,
freezegun, cryptography, apache-beam
=================================== log end ====================================
___________________________________ summary ____________________________________
[31mERROR: spark-runner-test: InvocationError for command
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/bin/python>
target/.tox-spark-runner-test/spark-runner-test/bin/pip install --retries 10
--exists-action w
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'>
(exited with code -15 (SIGTERM)) (exited with code -15)
[0mDaemon vm is shutting down... The daemon has exited normally or was
terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
> Task :sdks:python:test-suites:portable:py37:sparkCompatibilityMatrixLOOPBACK
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
