vyasr commented on issue #44342: URL: https://github.com/apache/arrow/issues/44342#issuecomment-2411775640
Installing the version with jemalloc disabled does seem to fix the problem. I installed the artifact from https://github.com/ursacomputing/crossbow/actions/runs/11286890348 (slightly different than the link posted above because I'm on Python 3.12) and tested it out, then downgraded again to be sure: ``` root@g242-p33-0009:/repo/new_wheel# pip install pyarrow-18.0.0.dev452-cp312-cp312-manylinux_2_28_aarch64.whl Looking in indexes: https://pypi.org/simple, https://pypi.anaconda.org/rapidsai-wheels-nightly/simple, https://pypi.nvidia.com Processing ./pyarrow-18.0.0.dev452-cp312-cp312-manylinux_2_28_aarch64.whl Installing collected packages: pyarrow Attempting uninstall: pyarrow Found existing installation: pyarrow 17.0.0 Uninstalling pyarrow-17.0.0: Successfully uninstalled pyarrow-17.0.0 Successfully installed pyarrow-18.0.0.dev452 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. root@g242-p33-0009:/repo/new_wheel# cd .. root@g242-p33-0009:/repo# python -c "import cupy; import cudf;" root@g242-p33-0009:/repo# pip install pyarrow==17.0.0 Looking in indexes: https://pypi.org/simple, https://pypi.anaconda.org/rapidsai-wheels-nightly/simple, https://pypi.nvidia.com Collecting pyarrow==17.0.0 Using cached pyarrow-17.0.0-cp312-cp312-manylinux_2_28_aarch64.whl.metadata (3.3 kB) Requirement already satisfied: numpy>=1.16.6 in /pyenv/versions/3.12.7/lib/python3.12/site-packages (from pyarrow==17.0.0) (2.0.2) Using cached pyarrow-17.0.0-cp312-cp312-manylinux_2_28_aarch64.whl (38.7 MB) Installing collected packages: pyarrow Attempting uninstall: pyarrow Found existing installation: pyarrow 18.0.0.dev452 Uninstalling pyarrow-18.0.0.dev452: Successfully uninstalled pyarrow-18.0.0.dev452 Successfully installed pyarrow-17.0.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. root@g242-p33-0009:/repo# python -c "import cupy; import cudf;" Segmentation fault (core dumped) ``` So that certainly seems promising. Once pyarrow 18 is released our CI will pick it up automatically, so we'll see if the problem recurs in any way in future builds. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
