vmalisz commented on issue #33814: URL: https://github.com/apache/arrow/issues/33814#issuecomment-1399419935
I followed exactly the instructions here: https://arrow.apache.org/docs/dev/developers/python.html#using-system-and-bundled-dependencies `git clone https://github.com/apache/arrow.git` `pushd arrow git submodule update --init export PARQUET_TEST_DATA="${PWD}/cpp/submodules/parquet-testing/data" export ARROW_TEST_DATA="${PWD}/testing/data" popd` `sudo apt-get install build-essential cmake python3-dev` `python3 -m venv pyarrow-dev source ./pyarrow-dev/bin/activate pip install -r arrow/python/requirements-build.txt # This is the folder where we will install the Arrow libraries during # development mkdir dist (forgot that part below initially) `export ARROW_HOME=$(pwd)/dist export LD_LIBRARY_PATH=$(pwd)/dist/lib:$LD_LIBRARY_PATH export CMAKE_PREFIX_PATH=$ARROW_HOME:$CMAKE_PREFIX_PATH` the error happened here at 'make install' `mkdir arrow/cpp/build pushd arrow/cpp/build cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ -DCMAKE_INSTALL_LIBDIR=lib \ -DCMAKE_BUILD_TYPE=Debug \ -DARROW_BUILD_TESTS=ON \ -DARROW_COMPUTE=ON \ -DARROW_CSV=ON \ -DARROW_DATASET=ON \ -DARROW_FILESYSTEM=ON \ -DARROW_HDFS=ON \ -DARROW_JSON=ON \ -DARROW_PARQUET=ON \ -DARROW_WITH_BROTLI=ON \ -DARROW_WITH_BZ2=ON \ -DARROW_WITH_LZ4=ON \ -DARROW_WITH_SNAPPY=ON \ -DARROW_WITH_ZLIB=ON \ -DARROW_WITH_ZSTD=ON \ -DPARQUET_REQUIRE_ENCRYPTION=ON \ .. make -j4 make install popd` trying again with https://arrow.apache.org/docs/dev/developers/cpp/building.html#cpp-building-building some confusion here tbh: - cmake I had installed with apt was 3.18 so I couldn't use --preset (available for version >3.21) - I install ($ make install) 3.25.2 from the [source](https://github.com/Kitware/CMake/releases/download/v3.25.2/cmake-3.25.2.tar.gz) - cmake --version didn't work as if cmake was not installed - I end up doing apt install again. it says 3.18 is being installed but cmake --version now says 3.25 ... anyways, moving on: `$ cmake .. --preset ninja-debug-minimal` worked ``` $ tree debug debug/ ├── libarrow_dataset.so -> libarrow_dataset.so.1100 ├── libarrow_dataset.so.1100 -> libarrow_dataset.so.1100.0.0 ├── libarrow_dataset.so.1100.0.0 ├── libarrow.so -> libarrow.so.1100 ├── libarrow.so.1100 -> libarrow.so.1100.0.0 ├── libarrow.so.1100.0.0 ├── libparquet.so -> libparquet.so.1100 ├── libparquet.so.1100 -> libparquet.so.1100.0.0 └── libparquet.so.1100.0.0 0 directories, 9 files ``` that part is a bit over my head, and I'm not sure where to go from there. Thanks again for your help! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
