See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/7461/display/redirect?page=changes>
Changes:
[noreply] [Python SDK] wait_until_finish always raises the exception for FAILED
------------------------------------------
[...truncated 68.00 KB...]
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_spark-runner-test.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/runners/portability/spark_runner_test.py::SparkRunnerTest::test_assert_that
======= 1 failed, 45 passed, 19 skipped, 2 warnings in 72.14s (0:01:12) ========
[31mERROR: InvocationError for command /bin/bash
scripts/pytest_validates_runner.sh spark-runner-test
apache_beam/runners/portability/spark_runner_test.py
'--spark_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.48.0-SNAPSHOT.jar>
--environment_type=LOOPBACK' (exited with code 1)
[0m[1mspark-runner-test run-test-post: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary
____________________________________
[31mERROR: spark-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:sparkCompatibilityMatrixLOOPBACK
> FAILED
> Task :sdks:python:test-suites:portable:py311:sparkCompatibilityMatrixLOOPBACK
[1mspark-runner-test create:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test>
[0m[1mspark-runner-test installdeps: -rbuild-requirements.txt
[0m[1mspark-runner-test inst:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1mspark-runner-test installed: apache-beam @
file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz>#sha256=28e4c2ca5695ab7bef5614a0f356aaef9081a54bf2222f85c79c68fdb2e67a0b,attrs==23.1.0,certifi==2023.5.7,cffi==1.15.1,charset-normalizer==3.1.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==40.0.2,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.6,dnspython==2.3.0,docker==6.1.1,docopt==0.6.2,execnet==1.9.0,fastavro==1.7.4,fasteners==0.18,freezegun==1.2.2,greenlet==2.0.2,grpcio==1.55.0rc1,grpcio-tools==1.53.0,hdfs==2.7.0,httplib2==0.22.0,hypothesis==6.75.2,idna==3.4,iniconfig==2.0.0,joblib==1.2.0,mock==5.0.2,mypy-protobuf==3.4.0,numpy==1.24.3,objsize==0.6.1,orjson==3.8.12,packaging==23.1,pandas==1.5.3,parameterized==0.9.0,pluggy==1.0.0,proto-plus==1.22.2,protobuf==4.22.4,psycopg2-binary==2.9.6,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==2.0.4,pymongo==4.4.0b0,PyMySQL==1.0.3,pyparsing==3.1.0b1,pytest==7.3.1,pytest-timeout==2.1.0,pytest-xdist==3.2.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0,regex==2023.5.5,requests==2.30.0,requests-mock==1.10.0,scikit-learn==1.2.2,scipy==1.10.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.48,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.1.0,types-protobuf==4.22.0.2,typing_extensions==4.5.0,urllib3==2.0.2,websocket-client==1.5.1,wrapt==1.15.0,zstandard==0.21.0
[0m[1mspark-runner-test run-test-pre: PYTHONHASHSEED='2693249073'
[0m[1mspark-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.11.2
[1mspark-runner-test run-test-pre: commands[1] | pip --version
[0mpip 23.1.2 from
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/pip>
(python 3.11)
[1mspark-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mspark-runner-test run-test-pre: commands[3] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mspark-runner-test run-test: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/pytest_validates_runner.sh>
spark-runner-test
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/spark_runner_test.py>
'--spark_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.48.0-SNAPSHOT.jar>
--environment_type=LOOPBACK'
[0m============================= test session starts
==============================
platform linux -- Python 3.11.2, pytest-7.3.1, pluggy-1.0.0
cachedir: target/.tox-spark-runner-test/spark-runner-test/.pytest_cache
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python>
configfile: pytest.ini
plugins: xdist-3.2.1, hypothesis-6.75.2, timeout-2.1.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 65 items
apache_beam/runners/portability/spark_runner_test.py ......s...s...ss... [ 29%]
......ss......ss..s............s.ssss..sssss.. [100%]
=============================== warnings summary ===============================
target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/pkg_resources/__init__.py:121
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/pkg_resources/__init__.py>:121:
DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
apache_beam/runners/portability/spark_runner_test.py::SparkRunnerTest::test_no_subtransform_composite
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
read_grpc_client_inputs
Traceback (most recent call last):
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 654, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/grpc/_channel.py";,>
line 475, in __next__
return self._next()
^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/grpc/_channel.py";,>
line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%5B::1%5D:41867 {created_time:"2023-05-08T18:40:42.96663757+00:00",
grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
apache_beam/runners/portability/spark_runner_test.py::SparkRunnerTest::test_pardo_state_with_custom_key_coder
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
read_grpc_client_inputs
Traceback (most recent call last):
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 654, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/grpc/_channel.py";,>
line 475, in __next__
return self._next()
^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/grpc/_channel.py";,>
line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%5B::1%5D:41087 {created_time:"2023-05-08T18:40:57.84169711+00:00",
grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/pytest_spark-runner-test.xml>
-
============ 46 passed, 19 skipped, 4 warnings in 68.65s (0:01:08) =============
[1mspark-runner-test run-test-post: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary
____________________________________
[32m spark-runner-test: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:portable:py311:sparkValidatesRunner
> Task :sdks:python:test-suites:portable:py37:sparkCompatibilityMatrixLOOPBACK
[1mspark-runner-test create:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test>
[0m[1mspark-runner-test installdeps: -rbuild-requirements.txt
[0m[1mspark-runner-test inst:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1mspark-runner-test installed: apache-beam @
file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==23.1.0,certifi==2023.5.7,cffi==1.15.1,charset-normalizer==3.1.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==40.0.2,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.6,dnspython==2.3.0,docker==6.1.1,docopt==0.6.2,exceptiongroup==1.1.1,execnet==1.9.0,fastavro==1.7.4,fasteners==0.18,freezegun==1.2.2,greenlet==2.0.2,grpcio==1.55.0rc1,grpcio-tools==1.53.0,hdfs==2.7.0,httplib2==0.22.0,hypothesis==6.75.2,idna==3.4,importlib-metadata==6.6.0,iniconfig==2.0.0,joblib==1.2.0,mock==5.0.2,mypy-protobuf==3.4.0,numpy==1.21.6,objsize==0.6.1,orjson==3.8.12,packaging==23.1,pandas==1.3.5,parameterized==0.9.0,pluggy==1.0.0,proto-plus==1.22.2,protobuf==4.22.4,psycopg2-binary==2.9.6,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==2.0.4,pymongo==4.4.0b0,PyMySQL==1.0.3,pyparsing==3.1.0b1,pytest==7.3.1,pytest-timeout==2.1.0,pytest-xdist==3.2.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0,regex==2023.5.5,requests==2.30.0,requests-mock==1.10.0,scikit-learn==1.0.2,scipy==1.7.3,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.48,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.1.0,tomli==2.0.1,types-protobuf==4.22.0.2,typing_extensions==4.5.0,urllib3==2.0.2,websocket-client==1.5.1,wrapt==1.15.0,zipp==3.15.0,zstandard==0.21.0>
[0m[1mspark-runner-test run-test-pre: PYTHONHASHSEED='2598546196'
[0m[1mspark-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.7.12
[1mspark-runner-test run-test-pre: commands[1] | pip --version
[0mpip 23.0.1 from
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.7/site-packages/pip>
(python 3.7)
[1mspark-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mspark-runner-test run-test-pre: commands[3] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mspark-runner-test run-test: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh>
spark-runner-test
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/portability/spark_runner_test.py>
'--spark_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.48.0-SNAPSHOT.jar>
--environment_type=LOOPBACK'
[0m============================= test session starts
==============================
platform linux -- Python 3.7.12, pytest-7.3.1, pluggy-1.0.0
cachedir: target/.tox-spark-runner-test/spark-runner-test/.pytest_cache
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python>
configfile: pytest.ini
plugins: xdist-3.2.1, hypothesis-6.75.2, timeout-2.1.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 65 items
apache_beam/runners/portability/spark_runner_test.py ......s...s...ss... [ 29%]
......ss......ss..s............s.ssss..sssss.. [100%]
=============================== warnings summary ===============================
target/.tox-spark-runner-test/spark-runner-test/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
target/.tox-spark-runner-test/spark-runner-test/lib/python3.7/site-packages/pkg_resources/__init__.py:121
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.7/site-packages/pkg_resources/__init__.py>:121:
DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/pytest_spark-runner-test.xml>
-
============ 46 passed, 19 skipped, 2 warnings in 79.85s (0:01:19) =============
[1mspark-runner-test run-test-post: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary
____________________________________
[32m spark-runner-test: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:portable:py37:sparkValidatesRunner
> Task :sdks:python:test-suites:portable:py39:sparkCompatibilityMatrixLOOPBACK
[1mspark-runner-test create:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test>
[0m[1mspark-runner-test installdeps: -rbuild-requirements.txt
[0m[1mspark-runner-test inst:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1mspark-runner-test installed: apache-beam @
file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/.tmp/package/1/apache-beam.tar.gz>#sha256=28e4c2ca5695ab7bef5614a0f356aaef9081a54bf2222f85c79c68fdb2e67a0b,attrs==23.1.0,certifi==2023.5.7,cffi==1.15.1,charset-normalizer==3.1.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==40.0.2,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.6,dnspython==2.3.0,docker==6.1.1,docopt==0.6.2,exceptiongroup==1.1.1,execnet==1.9.0,fastavro==1.7.4,fasteners==0.18,freezegun==1.2.2,greenlet==2.0.2,grpcio==1.55.0rc1,grpcio-tools==1.53.0,hdfs==2.7.0,httplib2==0.22.0,hypothesis==6.75.2,idna==3.4,iniconfig==2.0.0,joblib==1.2.0,mock==5.0.2,mypy-protobuf==3.4.0,numpy==1.24.3,objsize==0.6.1,orjson==3.8.12,packaging==23.1,pandas==1.5.3,parameterized==0.9.0,pluggy==1.0.0,proto-plus==1.22.2,protobuf==4.22.4,psycopg2-binary==2.9.6,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==2.0.4,pymongo==4.4.0b0,PyMySQL==1.0.3,pyparsing==3.1.0b1,pytest==7.3.1,pytest-timeout==2.1.0,pytest-xdist==3.2.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0,regex==2023.5.5,requests==2.30.0,requests-mock==1.10.0,scikit-learn==1.2.2,scipy==1.10.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.48,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.1.0,tomli==2.0.1,types-protobuf==4.22.0.2,typing_extensions==4.5.0,urllib3==2.0.2,websocket-client==1.5.1,wrapt==1.15.0,zstandard==0.21.0
[0m[1mspark-runner-test run-test-pre: PYTHONHASHSEED='2285777502'
[0m[1mspark-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.9.10
[1mspark-runner-test run-test-pre: commands[1] | pip --version
[0mpip 23.1.2 from
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.9/site-packages/pip>
(python 3.9)
[1mspark-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mspark-runner-test run-test-pre: commands[3] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mspark-runner-test run-test: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh>
spark-runner-test
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/spark_runner_test.py>
'--spark_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.48.0-SNAPSHOT.jar>
--environment_type=LOOPBACK'
[0m============================= test session starts
==============================
platform linux -- Python 3.9.10, pytest-7.3.1, pluggy-1.0.0
cachedir: target/.tox-spark-runner-test/spark-runner-test/.pytest_cache
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python>
configfile: pytest.ini
plugins: xdist-3.2.1, hypothesis-6.75.2, timeout-2.1.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 65 items
apache_beam/runners/portability/spark_runner_test.py ......s...s...ss... [ 29%]
......ss......ss..s............s.ssss..sssss.. [100%]
=============================== warnings summary ===============================
target/.tox-spark-runner-test/spark-runner-test/lib/python3.9/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.9/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
target/.tox-spark-runner-test/spark-runner-test/lib/python3.9/site-packages/pkg_resources/__init__.py:121
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.9/site-packages/pkg_resources/__init__.py>:121:
DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/pytest_spark-runner-test.xml>
-
============ 46 passed, 19 skipped, 2 warnings in 85.44s (0:01:25) =============
[1mspark-runner-test run-test-post: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary
____________________________________
[32m spark-runner-test: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:portable:py39:sparkValidatesRunner
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py38:sparkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m
83 actionable tasks: 53 executed, 28 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException:
com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at
com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at
com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at
com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/jyxtfmstodgua
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
