[
https://issues.apache.org/jira/browse/ARROW-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rok Mihevc updated ARROW-3992:
------------------------------
External issue URL: https://github.com/apache/arrow/issues/20595
> pyarrow compile from source issues on RedHat 7.4
> ------------------------------------------------
>
> Key: ARROW-3992
> URL: https://issues.apache.org/jira/browse/ARROW-3992
> Project: Apache Arrow
> Issue Type: Bug
> Reporter: David Lee
> Priority: Minor
>
> Opening a ticket for: [https://github.com/apache/arrow/issues/2281] after
> running into the same problems with RedHat 7.4.
> [https://arrow.apache.org/docs/python/development.html#development]
> Additional steps taken:
> Added double-conversion, glog and hypothesis:
> {code:java}
> conda create -y -q -n pyarrow-dev \
> python=3.6 numpy six setuptools cython pandas pytest double-conversion \
> cmake flatbuffers rapidjson boost-cpp thrift-cpp snappy zlib glog hypothesis\
> gflags brotli jemalloc lz4-c zstd -c conda-forge
> {code}
>
> Added export LD_LIBRARY_PATH to conda lib64 before running py.test pyarrow:
> {code:java}
> export LD_LIBRARY_PATH=/home/my_login/anaconda3/envs/pyarrow-dev/lib64
> py.test pyarrow
> {code}
>
> Added extra symlinks with a period at the end to fix string concatenation
> issues. Running setup.py for the first time didn't need this, but running
> setup.py a second time would error out with:
> {code:java}
> CMake Error: File
> /home/my_login/anaconda3/envs/pyarrow-dev/lib64/libarrow.so. does not exist.
> {code}
>
> There is an extra period at the end of the *.so files so I had to make
> symlinks with extra periods.
> {code:java}
> ln -s libparquet.so.12.0.0 libparquet.so.
> ln -s libplasma.so.12.0.0 libplasma.so.
> ln -s libarrow.so.12.0.0 libarrow.so.
> ln -s libarrow_python.so.12.0.0 libarrow_python.so.
> {code}
>
> Creating a wheel file using --with-plasma gives the following error:
> {code:java}
> error: [Errno 2] No such file or directory: 'release/plasma_store_server'
> {code}
> Had to create the wheel file without plasma, but it isn't packaged correctly.
> The hacked symlinked shared libs are included instead of libarrow.so.12
> {code:java}
> copying build/lib.linux-x86_64-3.6/pyarrow/libarrow.so. ->
> build/bdist.linux-x86_64/wheel/pyarrow
> copying build/lib.linux-x86_64-3.6/pyarrow/libarrow.so ->
> build/bdist.linux-x86_64/wheel/pyarrow
> copying build/lib.linux-x86_64-3.6/pyarrow/libarrow_python.so. ->
> build/bdist.linux-x86_64/wheel/pyarrow
> copying build/lib.linux-x86_64-3.6/pyarrow/libarrow_python.so ->
> build/bdist.linux-x86_64/wheel/pyarrow
> copying build/lib.linux-x86_64-3.6/pyarrow/libplasma.so. ->
> build/bdist.linux-x86_64/wheel/pyarrow
> copying build/lib.linux-x86_64-3.6/pyarrow/libplasma.so ->
> build/bdist.linux-x86_64/wheel/pyarrow
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)