bjornjorgensen commented on PR #53075:
URL: https://github.com/apache/spark/pull/53075#issuecomment-3535039553
docker build -t spark-pypy-local-test -f
dev/spark-test-image/pypy-310/Dockerfile .
=> ERROR [8/8] RUN pypy3 -m pip install numpy pyarrow>=22.0.0 six==1.16.0
pandas==2.3.3 scipy plotly<6.0.0 mlflow>=2.8.1 coverage matplotlib openpyxl
memory-profiler>=0.61.0 scikit-learn>=1.3.2 unittest-xml-reporting
grpcio==1.76.0 grpcio-status==1.76.0 protobuf==6.33.0 googleapis-commo 835.4s
------
> [8/8] RUN pypy3 -m pip install numpy pyarrow>=22.0.0 six==1.16.0
pandas==2.3.3 scipy plotly<6.0.0 mlflow>=2.8.1 coverage matplotlib openpyxl
memory-profiler>=0.61.0 scikit-learn>=1.3.2 unittest-xml-reporting
grpcio==1.76.0 grpcio-status==1.76.0 protobuf==6.33.0
googleapis-common-protos==1.71.0 zstandard==0.25.0 graphviz==0.20.3 &&
pypy3 -m pip install torch torchvision --index-url
https://download.pytorch.org/whl/cpu && pypy3 -m pip install deepspeed
torcheval && pypy3 -m pip cache purge:
4.280 Collecting numpy
7.567 Downloading
numpy-2.2.6-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
(62 kB)
7.663 Collecting pyarrow>=22.0.0
7.781 Downloading pyarrow-22.0.0.tar.gz (1.2 MB)
7.938 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 7.4 MB/s
0:00:00
8.151 Installing build dependencies: started
18.99 Installing build dependencies: finished with status 'done'
19.00 Getting requirements to build wheel: started
19.97 Getting requirements to build wheel: finished with status 'done'
19.97 Preparing metadata (pyproject.toml): started
20.51 Preparing metadata (pyproject.toml): finished with status 'done'
20.51 Requirement already satisfied: six==1.16.0 in
/usr/local/pypy/pypy3.10/lib/pypy3.10/site-packages (1.16.0)
20.62 Collecting pandas==2.3.3
20.64 Downloading pandas-2.3.3.tar.gz (4.5 MB)
20.74 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 45.9 MB/s
0:00:00
21.64 Installing build dependencies: started
30.45 Installing build dependencies: finished with status 'done'
30.45 Getting requirements to build wheel: started
30.68 Getting requirements to build wheel: finished with status 'done'
30.69 Installing backend dependencies: started
38.09 Installing backend dependencies: finished with status 'done'
38.09 Preparing metadata (pyproject.toml): started
98.93 Preparing metadata (pyproject.toml): still running...
160.0 Preparing metadata (pyproject.toml): still running...
161.6 Preparing metadata (pyproject.toml): finished with status 'done'
161.8 Collecting scipy
162.0 Downloading scipy-1.15.3.tar.gz (59.4 MB)
168.3 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.4/59.4 MB 9.3 MB/s
0:00:06
173.4 Installing build dependencies: started
184.5 Installing build dependencies: finished with status 'done'
184.5 Getting requirements to build wheel: started
184.7 Getting requirements to build wheel: finished with status 'done'
184.7 Installing backend dependencies: started
188.8 Installing backend dependencies: finished with status 'done'
188.8 Preparing metadata (pyproject.toml): started
249.3 Preparing metadata (pyproject.toml): still running...
309.5 Preparing metadata (pyproject.toml): still running...
369.6 Preparing metadata (pyproject.toml): still running...
424.8 Preparing metadata (pyproject.toml): finished with status 'done'
424.8 Collecting plotly<6.0.0
424.9 Downloading plotly-5.24.1-py3-none-any.whl.metadata (7.3 kB)
424.9 Collecting mlflow>=2.8.1
424.9 Downloading mlflow-3.6.0-py3-none-any.whl.metadata (31 kB)
425.1 Collecting coverage
425.1 Downloading coverage-7.11.3-py3-none-any.whl.metadata (9.1 kB)
425.3 Collecting matplotlib
425.4 Downloading
matplotlib-3.10.7-pp310-pypy310_pp73-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata
(11 kB)
425.5 Collecting openpyxl
425.6 Downloading openpyxl-3.1.5-py2.py3-none-any.whl.metadata (2.5 kB)
425.7 Collecting memory-profiler>=0.61.0
425.8 Downloading memory_profiler-0.61.0-py3-none-any.whl.metadata (20 kB)
425.9 Collecting scikit-learn>=1.3.2
425.9 Downloading scikit_learn-1.7.2.tar.gz (7.2 MB)
426.2 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.2/7.2 MB 24.6 MB/s
0:00:00
426.8 Installing build dependencies: started
510.8 Installing build dependencies: still running...
571.1 Installing build dependencies: still running...
631.2 Installing build dependencies: still running...
691.2 Installing build dependencies: still running...
693.9 Installing build dependencies: finished with status 'done'
693.9 Getting requirements to build wheel: started
694.1 Getting requirements to build wheel: finished with status 'done'
694.1 Installing backend dependencies: started
698.2 Installing backend dependencies: finished with status 'done'
698.2 Preparing metadata (pyproject.toml): started
758.6 Preparing metadata (pyproject.toml): still running...
800.3 Preparing metadata (pyproject.toml): finished with status 'done'
800.3 Collecting unittest-xml-reporting
800.3 Downloading
unittest_xml_reporting-3.2.0-py2.py3-none-any.whl.metadata (11 kB)
800.6 Collecting grpcio==1.76.0
800.6 Downloading grpcio-1.76.0.tar.gz (12.8 MB)
801.4 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.8/12.8 MB 15.1 MB/s
0:00:00
803.4 Installing build dependencies: started
807.8 Installing build dependencies: finished with status 'done'
807.8 Getting requirements to build wheel: started
808.6 Getting requirements to build wheel: finished with status 'done'
808.6 Preparing metadata (pyproject.toml): started
809.2 Preparing metadata (pyproject.toml): finished with status 'done'
809.5 Collecting grpcio-status==1.76.0
809.6 Downloading grpcio_status-1.76.0-py3-none-any.whl.metadata (1.1 kB)
809.6 Collecting protobuf==6.33.0
809.7 Downloading protobuf-6.33.0-py3-none-any.whl.metadata (593 bytes)
809.7 Collecting googleapis-common-protos==1.71.0
809.7 Downloading
googleapis_common_protos-1.71.0-py3-none-any.whl.metadata (9.4 kB)
809.8 Collecting zstandard==0.25.0
809.9 Downloading zstandard-0.25.0.tar.gz (711 kB)
809.9 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 711.5/711.5 kB 37.1 MB/s
0:00:00
810.0 Installing build dependencies: started
814.4 Installing build dependencies: finished with status 'done'
814.4 Getting requirements to build wheel: started
815.5 Getting requirements to build wheel: finished with status 'done'
815.5 Preparing metadata (pyproject.toml): started
816.2 Preparing metadata (pyproject.toml): finished with status 'done'
816.2 Collecting graphviz==0.20.3
816.2 Downloading graphviz-0.20.3-py3-none-any.whl.metadata (12 kB)
816.3 Collecting python-dateutil>=2.8.2 (from pandas==2.3.3)
816.3 Downloading
python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
816.4 Collecting pytz>=2020.1 (from pandas==2.3.3)
816.4 Downloading pytz-2025.2-py2.py3-none-any.whl.metadata (22 kB)
816.4 Collecting tzdata>=2022.7 (from pandas==2.3.3)
816.4 Downloading tzdata-2025.2-py2.py3-none-any.whl.metadata (1.4 kB)
816.5 Collecting typing-extensions~=4.12 (from grpcio==1.76.0)
816.5 Downloading typing_extensions-4.15.0-py3-none-any.whl.metadata (3.3
kB)
816.6 Collecting tenacity>=6.2.0 (from plotly<6.0.0)
816.6 Downloading tenacity-9.1.2-py3-none-any.whl.metadata (1.2 kB)
816.6 Collecting packaging (from plotly<6.0.0)
816.6 Using cached packaging-25.0-py3-none-any.whl.metadata (3.3 kB)
816.7 Collecting mlflow-skinny==3.6.0 (from mlflow>=2.8.1)
816.7 Downloading mlflow_skinny-3.6.0-py3-none-any.whl.metadata (31 kB)
816.8 Collecting mlflow-tracing==3.6.0 (from mlflow>=2.8.1)
816.8 Downloading mlflow_tracing-3.6.0-py3-none-any.whl.metadata (19 kB)
816.9 Collecting Flask-CORS<7 (from mlflow>=2.8.1)
816.9 Downloading flask_cors-6.0.1-py3-none-any.whl.metadata (5.3 kB)
817.0 Collecting Flask<4 (from mlflow>=2.8.1)
817.0 Downloading flask-3.1.2-py3-none-any.whl.metadata (3.2 kB)
817.0 Collecting alembic!=1.10.0,<2 (from mlflow>=2.8.1)
817.1 Downloading alembic-1.17.2-py3-none-any.whl.metadata (7.2 kB)
817.1 Collecting cryptography<47,>=43.0.0 (from mlflow>=2.8.1)
817.2 Downloading cryptography-46.0.3.tar.gz (749 kB)
817.2 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 749.3/749.3 kB 37.3 MB/s
0:00:00
817.3 Installing build dependencies: started
825.7 Installing build dependencies: finished with status 'done'
825.7 Getting requirements to build wheel: started
825.8 Getting requirements to build wheel: finished with status 'done'
825.8 Installing backend dependencies: started
834.2 Installing backend dependencies: finished with status 'done'
834.2 Preparing metadata (pyproject.toml): started
834.3 Preparing metadata (pyproject.toml): finished with status 'error'
834.3 error: subprocess-exited-with-error
834.3
834.3 × Preparing metadata (pyproject.toml) did not run successfully.
834.3 │ exit code: 1
834.3 ╰─> [4 lines of output]
834.3 Python reports SOABI: pypy310-pp73
834.3 Unsupported platform: pp73
834.3 Checking for Rust toolchain....
834.3 Rust not found, installing into a temporary directory
834.3 [end of output]
834.3
834.3 note: This error originates from a subprocess, and is likely not a
problem with pip.
834.3 error: metadata-generation-failed
834.3
834.3 × Encountered error while generating package metadata.
834.3 ╰─> cryptography
834.3
834.3 note: This is an issue with the package mentioned above, not pip.
834.3 hint: See above for details.
------
Dockerfile:77
--------------------
76 | RUN pypy3 -m pip install --ignore-installed 'six==1.16.0' #
Avoid `python3-six` installation
77 | >>> RUN pypy3 -m pip install $BASIC_PIP_PKGS unittest-xml-reporting
$CONNECT_PIP_PKGS && \
78 | >>> pypy3 -m pip install torch torchvision --index-url
https://download.pytorch.org/whl/cpu && \
79 | >>> pypy3 -m pip install deepspeed torcheval && \
80 | >>> pypy3 -m pip cache purge
--------------------
ERROR: failed to build: failed to solve: process "/bin/sh -c pypy3 -m pip
install $BASIC_PIP_PKGS unittest-xml-reporting $CONNECT_PIP_PKGS && pypy3
-m pip install torch torchvision --index-url
https://download.pytorch.org/whl/cpu && pypy3 -m pip install deepspeed
torcheval && pypy3 -m pip cache purge" did not complete successfully: exit
code: 1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
