See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/7804/display/redirect>
Changes: ------------------------------------------ [...truncated 83.05 KB...] > Task :sdks:python:test-suites:portable:py311:sparkCompatibilityMatrixLOOPBACK .pkg_external: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external> .pkg_external_sdist_meta: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external_sdist_meta> spark-runner-test: install_deps> target/.tox-spark-runner-test/spark-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/bin/pip> install --retries 10 --pre -r build-requirements.txt .pkg_external: freeze> python -m pip freeze --all .pkg_external: pip==23.1.2,setuptools==68.0.0,wheel==0.40.0 .pkg_external_sdist_meta: install_requires> python -I -m pip install 'setuptools>=40.8.0' wheel .pkg_external_sdist_meta: _optional_hooks <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_sdist <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: install_requires_for_build_wheel> python -I -m pip install wheel .pkg_external_sdist_meta: freeze> python -m pip freeze --all .pkg_external_sdist_meta: pip==23.1.2,setuptools==68.0.0,wheel==0.40.0 .pkg_external_sdist_meta: prepare_metadata_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ spark-runner-test: install_package_deps> target/.tox-spark-runner-test/spark-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/bin/pip> install --retries 10 --pre 'cloudpickle~=2.2.1' 'crcmod<2.0,>=1.7' 'cryptography>=41.0.2' 'dill<0.3.2,>=0.3.1.1' 'fastavro<2,>=0.23.6' 'fasteners<1.0,>=0.3' 'freezegun>=0.3.12' 'grpcio!=1.48.0,<2,>=1.33.1' 'hdfs<3.0.0,>=2.1.0' 'httplib2<0.23.0,>=0.8' 'hypothesis<=7.0.0,>5.0.0' 'joblib>=1.0.1' 'mock<6.0.0,>=1.0.1' 'numpy<1.25.0,>=1.14.3' 'objsize<0.7.0,>=0.6.1' 'orjson<4.0' 'pandas<2.0.0' 'parameterized<0.10.0,>=0.7.1' 'proto-plus<2,>=1.7.1' 'protobuf<4.24.0,>=3.20.3' 'psycopg2-binary<3.0.0,>=2.8.5' 'pyarrow<12.0.0,>=3.0.0' 'pydot<2,>=1.2.0' 'pyhamcrest!=1.10.0,<3.0.0,>=1.9' 'pymongo<5.0.0,>=3.8.0' 'pytest-timeout<3,>=2.1.0' 'pytest-xdist<4,>=2.5.0' 'pytest<8.0,>=7.1.2' 'python-dateutil<3,>=2.8.0' 'pytz>=2018.3' 'pyyaml<7.0.0,>=3.12' 'regex>=2020.6.8' 'requests-mock<2.0,>=1.7' 'requests<3.0.0,>=2.24.0' 'scikit-learn>=0.20.0' 'sqlalchemy<2.0,>=1.3' 'tenacity<9,>=8.0.0' 'testcontainers[mysql]<4.0.0,>=3.0.3' 'typing-extensions>=3.7.0' 'zstandard<1,>=0.18.0' spark-runner-test: install_package> target/.tox-spark-runner-test/spark-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/bin/pip> install --retries 10 --pre --force-reinstall --no-deps <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build/apache-beam.tar.gz> spark-runner-test: freeze> target/.tox-spark-runner-test/spark-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/bin/pip> freeze spark-runner-test: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build/apache-beam.tar.gz>#sha256=09596d06898e2b1b9e0b8298070051f58c2806b832e5faa29657c02a5579ec78,attrs==23.1.0,certifi==2023.7.22,cffi==1.15.1,charset-normalizer==3.2.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==41.0.3,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.7,dnspython==2.4.1,docker==6.1.3,docopt==0.6.2,execnet==2.0.2,fastavro==1.8.2,fasteners==0.18,freezegun==1.2.2,greenlet==3.0.0a1,grpcio==1.57.0rc1,grpcio-tools==1.53.0,hdfs==2.7.0,httplib2==0.22.0,hypothesis==6.82.0,idna==3.4,iniconfig==2.0.0,joblib==1.3.1,mock==5.1.0,mypy-protobuf==3.5.0,numpy==1.24.4,objsize==0.6.1,orjson==3.9.2,packaging==23.1,pandas==1.5.3,parameterized==0.9.0,pluggy==1.2.0,proto-plus==1.22.3,protobuf==4.23.4,psycopg2-binary==2.9.6,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==2.0.4,pymongo==4.4.1,PyMySQL==1.1.0,pyparsing==3.1.1,pytest==7.4.0,pytest-timeout==2.1.0,pytest-xdist==3.3.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0.1,regex==2023.6.3,requests==2.31.0,requests-mock==1.11.0,scikit-learn==1.3.0,scipy==1.11.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.49,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.2.0,types-protobuf==4.23.0.2,typing_extensions==4.7.1,urllib3==2.0.4,websocket-client==1.6.1,wrapt==1.15.0,zstandard==0.21.0 spark-runner-test: commands_pre[0]> python --version Python 3.11.2 spark-runner-test: commands_pre[1]> pip --version pip 23.1.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/pip> (python 3.11) spark-runner-test: commands_pre[2]> pip check No broken requirements found. spark-runner-test: commands_pre[3]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> spark-runner-test: commands[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> spark-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/spark_runner_test.py> '--spark_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.50.0-SNAPSHOT.jar> --environment_type=LOOPBACK' ============================= test session starts ============================== platform linux -- Python 3.11.2, pytest-7.4.0, pluggy-1.2.0 cachedir: target/.tox-spark-runner-test/spark-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python> configfile: pytest.ini plugins: hypothesis-6.82.0, xdist-3.3.1, requests-mock-1.11.0, timeout-2.1.0 timeout: 600.0s timeout method: signal timeout func_only: False collected 66 items apache_beam/runners/portability/spark_runner_test.py ......s...s...ss... [ 28%] .......ss......ss..s............s.ssss..sssss.. [100%] =============================== warnings summary =============================== target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/lib/python3.11/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses from imp import load_source apache_beam/runners/portability/stager.py:63 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/stager.py>:63: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html import pkg_resources -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/pytest_spark-runner-test.xml> - ============ 47 passed, 19 skipped, 2 warnings in 61.37s (0:01:01) ============= spark-runner-test: commands_post[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> .pkg_external_sdist_meta: _exit <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ spark-runner-test: OK (129.86=setup[64.88]+cmd[0.00,0.38,1.01,0.02,63.53,0.03] seconds) congratulations :) (129.99 seconds) > Task :sdks:python:test-suites:portable:py311:sparkValidatesRunner > Task :sdks:python:test-suites:portable:py39:sparkCompatibilityMatrixLOOPBACK .pkg_external: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external> .pkg_external_sdist_meta: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external_sdist_meta> spark-runner-test: install_deps> target/.tox-spark-runner-test/spark-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/bin/pip> install --retries 10 --pre -r build-requirements.txt .pkg_external: freeze> python -m pip freeze --all .pkg_external: pip==23.1.2,setuptools==68.0.0,wheel==0.40.0 .pkg_external_sdist_meta: install_requires> python -I -m pip install 'setuptools>=40.8.0' wheel .pkg_external_sdist_meta: _optional_hooks <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_sdist <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: install_requires_for_build_wheel> python -I -m pip install wheel .pkg_external_sdist_meta: freeze> python -m pip freeze --all .pkg_external_sdist_meta: pip==23.1.2,setuptools==68.0.0,wheel==0.40.0 .pkg_external_sdist_meta: prepare_metadata_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ spark-runner-test: install_package_deps> target/.tox-spark-runner-test/spark-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/bin/pip> install --retries 10 --pre 'cloudpickle~=2.2.1' 'crcmod<2.0,>=1.7' 'cryptography>=41.0.2' 'dill<0.3.2,>=0.3.1.1' 'fastavro<2,>=0.23.6' 'fasteners<1.0,>=0.3' 'freezegun>=0.3.12' 'grpcio!=1.48.0,<2,>=1.33.1' 'hdfs<3.0.0,>=2.1.0' 'httplib2<0.23.0,>=0.8' 'hypothesis<=7.0.0,>5.0.0' 'joblib>=1.0.1' 'mock<6.0.0,>=1.0.1' 'numpy<1.25.0,>=1.14.3' 'objsize<0.7.0,>=0.6.1' 'orjson<4.0' 'pandas<2.0.0' 'parameterized<0.10.0,>=0.7.1' 'proto-plus<2,>=1.7.1' 'protobuf<4.24.0,>=3.20.3' 'psycopg2-binary<3.0.0,>=2.8.5' 'pyarrow<12.0.0,>=3.0.0' 'pydot<2,>=1.2.0' 'pyhamcrest!=1.10.0,<3.0.0,>=1.9' 'pymongo<5.0.0,>=3.8.0' 'pytest-timeout<3,>=2.1.0' 'pytest-xdist<4,>=2.5.0' 'pytest<8.0,>=7.1.2' 'python-dateutil<3,>=2.8.0' 'pytz>=2018.3' 'pyyaml<7.0.0,>=3.12' 'regex>=2020.6.8' 'requests-mock<2.0,>=1.7' 'requests<3.0.0,>=2.24.0' 'scikit-learn>=0.20.0' 'sqlalchemy<2.0,>=1.3' 'tenacity<9,>=8.0.0' 'testcontainers[mysql]<4.0.0,>=3.0.3' 'typing-extensions>=3.7.0' 'zstandard<1,>=0.18.0' Collecting cloudpickle~=2.2.1 [31mERROR: Could not install packages due to an OSError: [Errno 28] No space left on device Using cached cloudpickle-2.2.1-py3-none-any.whl (25 kB) Collecting crcmod<2.0,>=1.7 Using cached crcmod-1.7-cp39-cp39-linux_x86_64.whl Collecting cryptography>=41.0.2 Using cached cryptography-41.0.3-cp37-abi3-manylinux_2_28_x86_64.whl (4.3 MB) Collecting dill<0.3.2,>=0.3.1.1 Using cached dill-0.3.1.1-py3-none-any.whl Collecting fastavro<2,>=0.23.6 Using cached fastavro-1.8.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB) Collecting fasteners<1.0,>=0.3 Using cached fasteners-0.18-py3-none-any.whl (18 kB) Collecting freezegun>=0.3.12 Using cached freezegun-1.2.2-py3-none-any.whl (17 kB) Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in ./target/.tox-spark-runner-test/spark-runner-test/lib/python3.9/site-packages (1.57.0rc1) Collecting hdfs<3.0.0,>=2.1.0 Using cached hdfs-2.7.0-py3-none-any.whl (34 kB) Collecting httplib2<0.23.0,>=0.8 Using cached httplib2-0.22.0-py3-none-any.whl (96 kB) Collecting hypothesis<=7.0.0,>5.0.0 Using cached hypothesis-6.82.0-py3-none-any.whl (414 kB) Collecting joblib>=1.0.1 Using cached joblib-1.3.1-py3-none-any.whl (301 kB) Collecting mock<6.0.0,>=1.0.1 Using cached mock-5.1.0-py3-none-any.whl (30 kB) Collecting numpy<1.25.0,>=1.14.3 Using cached numpy-1.24.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB) Collecting objsize<0.7.0,>=0.6.1 Using cached objsize-0.6.1-py3-none-any.whl (9.3 kB) Collecting orjson<4.0 Using cached orjson-3.9.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB) Collecting pandas<2.0.0 Using cached pandas-1.5.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.2 MB) Collecting parameterized<0.10.0,>=0.7.1 Using cached parameterized-0.9.0-py2.py3-none-any.whl (20 kB) Collecting proto-plus<2,>=1.7.1 Using cached proto_plus-1.22.3-py3-none-any.whl (48 kB) Collecting protobuf<4.24.0,>=3.20.3 Using cached protobuf-4.23.4-cp37-abi3-manylinux2014_x86_64.whl (304 kB) Collecting psycopg2-binary<3.0.0,>=2.8.5 Using cached psycopg2_binary-2.9.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB) Collecting pyarrow<12.0.0,>=3.0.0 Using cached pyarrow-11.0.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.9 MB) Collecting pydot<2,>=1.2.0 Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB) Collecting pyhamcrest!=1.10.0,<3.0.0,>=1.9 Using cached pyhamcrest-2.0.4-py3-none-any.whl (52 kB) Collecting pymongo<5.0.0,>=3.8.0 Using cached pymongo-4.4.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (602 kB) Collecting pytest-timeout<3,>=2.1.0 Using cached pytest_timeout-2.1.0-py3-none-any.whl (12 kB) Collecting pytest-xdist<4,>=2.5.0 Using cached pytest_xdist-3.3.1-py3-none-any.whl (41 kB) Collecting pytest<8.0,>=7.1.2 Using cached pytest-7.4.0-py3-none-any.whl (323 kB) Collecting python-dateutil<3,>=2.8.0 Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) Collecting pytz>=2018.3 Using cached pytz-2023.3-py2.py3-none-any.whl (502 kB) Collecting pyyaml<7.0.0,>=3.12 Using cached PyYAML-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (738 kB) Collecting regex>=2020.6.8 Using cached regex-2023.6.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (769 kB) Collecting requests-mock<2.0,>=1.7 Using cached requests_mock-1.11.0-py2.py3-none-any.whl (28 kB) Collecting requests<3.0.0,>=2.24.0 Using cached requests-2.31.0-py3-none-any.whl (62 kB) Collecting scikit-learn>=0.20.0 Using cached scikit_learn-1.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (10.9 MB) Collecting sqlalchemy<2.0,>=1.3 Using cached SQLAlchemy-1.4.49-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB) Collecting tenacity<9,>=8.0.0 Using cached tenacity-8.2.2-py3-none-any.whl (24 kB) Collecting testcontainers[mysql]<4.0.0,>=3.0.3 Using cached testcontainers-3.7.1-py2.py3-none-any.whl (45 kB) Collecting typing-extensions>=3.7.0 Using cached typing_extensions-4.7.1-py3-none-any.whl (33 kB) Collecting zstandard<1,>=0.18.0 Using cached zstandard-0.21.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB) Collecting cffi>=1.12 (from cryptography>=41.0.2) Using cached cffi-1.15.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (441 kB) Collecting docopt (from hdfs<3.0.0,>=2.1.0) Using cached docopt-0.6.2-py2.py3-none-any.whl Collecting six>=1.9.0 (from hdfs<3.0.0,>=2.1.0) Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 (from httplib2<0.23.0,>=0.8) Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB) Collecting attrs>=19.2.0 (from hypothesis<=7.0.0,>5.0.0) Using cached attrs-23.1.0-py3-none-any.whl (61 kB) Collecting sortedcontainers<3.0.0,>=2.1.0 (from hypothesis<=7.0.0,>5.0.0) Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting exceptiongroup>=1.0.0 (from hypothesis<=7.0.0,>5.0.0) Using cached exceptiongroup-1.1.2-py3-none-any.whl (14 kB) Collecting dnspython<3.0.0,>=1.16.0 (from pymongo<5.0.0,>=3.8.0) Using cached dnspython-2.4.1-py3-none-any.whl (300 kB) Collecting execnet>=1.1 (from pytest-xdist<4,>=2.5.0) Using cached execnet-2.0.2-py3-none-any.whl (37 kB) Collecting iniconfig (from pytest<8.0,>=7.1.2) Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB) Collecting packaging (from pytest<8.0,>=7.1.2) Using cached packaging-23.1-py3-none-any.whl (48 kB) Collecting pluggy<2.0,>=0.12 (from pytest<8.0,>=7.1.2) Using cached pluggy-1.2.0-py3-none-any.whl (17 kB) Collecting tomli>=1.0.0 (from pytest<8.0,>=7.1.2) Using cached tomli-2.0.1-py3-none-any.whl (12 kB) Collecting charset-normalizer<4,>=2 (from requests<3.0.0,>=2.24.0) Using cached charset_normalizer-3.2.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (202 kB) Collecting idna<4,>=2.5 (from requests<3.0.0,>=2.24.0) Using cached idna-3.4-py3-none-any.whl (61 kB) Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0) Using cached urllib3-2.0.4-py3-none-any.whl (123 kB) Collecting certifi>=2017.4.17 (from requests<3.0.0,>=2.24.0) Using cached certifi-2023.7.22-py3-none-any.whl (158 kB) Collecting scipy>=1.5.0 (from scikit-learn>=0.20.0) Using cached scipy-1.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (36.5 MB) Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0) Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB) Collecting greenlet!=0.4.17 (from sqlalchemy<2.0,>=1.3) Using cached greenlet-3.0.0a1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (606 kB) Collecting docker>=4.0.0 (from testcontainers[mysql]<4.0.0,>=3.0.3) Using cached docker-6.1.3-py3-none-any.whl (148 kB) Collecting wrapt (from testcontainers[mysql]<4.0.0,>=3.0.3) Using cached wrapt-1.15.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (78 kB) Collecting deprecation (from testcontainers[mysql]<4.0.0,>=3.0.3) Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB) Collecting pymysql (from testcontainers[mysql]<4.0.0,>=3.0.3) Using cached PyMySQL-1.1.0-py3-none-any.whl (44 kB) Collecting pycparser (from cffi>=1.12->cryptography>=41.0.2) Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting websocket-client>=0.32.0 (from docker>=4.0.0->testcontainers[mysql]<4.0.0,>=3.0.3) Using cached websocket_client-1.6.1-py3-none-any.whl (56 kB) Installing collected packages: sortedcontainers, pytz, docopt, crcmod, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, six, regex, pyyaml, pyparsing, pymysql, pyhamcrest, pycparser, psycopg2-binary, protobuf, pluggy, parameterized, packaging, orjson, objsize, numpy, mock, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dnspython, dill, cloudpickle, charset-normalizer, certifi, attrs, sqlalchemy, scipy, requests, python-dateutil, pytest, pymongo, pydot, pyarrow, proto-plus, hypothesis, httplib2, deprecation, cffi, scikit-learn, requests-mock, pytest-xdist, pytest-timeout, pandas, hdfs, freezegun, docker, cryptography, testcontainers Attempting uninstall: protobuf Found existing installation: protobuf 4.24.0rc3 Uninstalling protobuf-4.24.0rc3: Successfully uninstalled protobuf-4.24.0rc3 Attempting uninstall: numpy Found existing installation: numpy 1.25.2 Uninstalling numpy-1.25.2: Successfully uninstalled numpy-1.25.2 spark-runner-test: exit 1 (30.08 seconds) <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python>> target/.tox-spark-runner-test/spark-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/spark-runner-test/bin/pip> install --retries 10 --pre 'cloudpickle~=2.2.1' 'crcmod<2.0,>=1.7' 'cryptography>=41.0.2' 'dill<0.3.2,>=0.3.1.1' 'fastavro<2,>=0.23.6' 'fasteners<1.0,>=0.3' 'freezegun>=0.3.12' 'grpcio!=1.48.0,<2,>=1.33.1' 'hdfs<3.0.0,>=2.1.0' 'httplib2<0.23.0,>=0.8' 'hypothesis<=7.0.0,>5.0.0' 'joblib>=1.0.1' 'mock<6.0.0,>=1.0.1' 'numpy<1.25.0,>=1.14.3' 'objsize<0.7.0,>=0.6.1' 'orjson<4.0' 'pandas<2.0.0' 'parameterized<0.10.0,>=0.7.1' 'proto-plus<2,>=1.7.1' 'protobuf<4.24.0,>=3.20.3' 'psycopg2-binary<3.0.0,>=2.8.5' 'pyarrow<12.0.0,>=3.0.0' 'pydot<2,>=1.2.0' 'pyhamcrest!=1.10.0,<3.0.0,>=1.9' 'pymongo<5.0.0,>=3.8.0' 'pytest-timeout<3,>=2.1.0' 'pytest-xdist<4,>=2.5.0' 'pytest<8.0,>=7.1.2' 'python-dateutil<3,>=2.8.0' 'pytz>=2018.3' 'pyyaml<7.0.0,>=3.12' 'regex>=2020.6.8' 'requests-mock<2.0,>=1.7' 'requests<3.0.0,>=2.24.0' 'scikit-learn>=0.20.0' 'sqlalchemy<2.0,>=1.3' 'tenacity<9,>=8.0.0' 'testcontainers[mysql]<4.0.0,>=3.0.3' 'typing-extensions>=3.7.0' 'zstandard<1,>=0.18.0' pid=1533184 .pkg_external_sdist_meta: _exit <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-spark-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ [39m spark-runner-test: FAIL code 1 (44.24 seconds) evaluation failed :( (44.41 seconds) > Task :sdks:python:test-suites:portable:py39:sparkCompatibilityMatrixLOOPBACK > FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py39:sparkCompatibilityMatrixLOOPBACK'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 5m 53s 81 actionable tasks: 51 executed, 28 from cache, 2 up-to-date Publishing build scan... https://ge.apache.org/s/xgibxouclaq44 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
