Andrew Wieteska created ARROW-10218:
---------------------------------------
Summary: [Python] [C++] Errors when building pyarrow from source
Key: ARROW-10218
URL: https://issues.apache.org/jira/browse/ARROW-10218
Project: Apache Arrow
Issue Type: Bug
Reporter: Andrew Wieteska
Not 100% sure this is the right place for this (maybe users/devs mailing lists
would be better?)
In any case, I've recently been having trouble building pyarrow from source and
I'm not sure where to debug. I use the following script (which worked fine
until the last week or so):
{code:java}
export ARROW_HOME=$CONDA_PREFIX
cd cpp/build
cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
-DCMAKE_INSTALL_LIBDIR=lib \
-DARROW_WITH_BZ2=ON \
-DARROW_WITH_ZLIB=ON \
-DARROW_WITH_ZSTD=ON \
-DARROW_WITH_LZ4=ON \
-DARROW_WITH_SNAPPY=ON \
-DARROW_WITH_BROTLI=ON \
-DARROW_PARQUET=ON \
-DARROW_PYTHON3=ON \
-DARROW_IPC=ON \
-DARROW_BUILD_TESTS=ON \
..
make -j4
sudo make install
cd ../../python
export PYARROW_WITH_PARQUET=1
python setup.py build_ext --inplace
cd ..
{code}
and on current master (Oct 7th '20) I get this error:
{code:java}
[ 5%] Compiling Cython CXX source for _fs...
[ 5%] Built target _fs_pyx
Scanning dependencies of target _fs
[ 11%] Building CXX object CMakeFiles/_fs.dir/_fs.cpp.o
/home/andrew/git_repo/arrow/python/build/temp.linux-x86_64-3.7/_fs.cpp:700:10:
fatal error: arrow/python/ipc.h: No such file or directory
#include "arrow/python/ipc.h"
^~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[2]: *** [CMakeFiles/_fs.dir/build.make:82: CMakeFiles/_fs.dir/_fs.cpp.o]
Error 1
make[1]: *** [CMakeFiles/Makefile2:138: CMakeFiles/_fs.dir/all] Error 2
make: *** [Makefile:103: all] Error 2
error: command 'cmake' failed with exit status 2
{code}
I'm pretty sure this is an issue with the local toolchain because I've pushed
to a Python PR since this happened and CI is green.
I appreciate any hints on how to go about solving this!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
