AlenkaF commented on PR #13311:
URL: https://github.com/apache/arrow/pull/13311#issuecomment-1223825265
I have gone through the nightly failures and there are some that are
connected to this PR.
@raulcd @kou could I get your feedback on the first three?
**almalinkux and centos failures**
---
Some of the Arrow modules (`gandiva-devel`, `arrow-dataset-devel`) seem to
think they need python libs and they can not find them as they are not in the
Arrow C++ part anymore.
<details>
<summary>almalinkux example log</summary>
<br>
```
...
Provides: cmake(Gandiva) = 10.0.0 cmake(gandiva) = 10.0.0 gandiva-devel =
9.0.0.dev738-1.el8 gandiva-devel(x86-64) = 9.0.0.dev738-1.el8
pkgconfig(gandiva) = 10.0.0-SNAPSHOT
Requires(rpmlib): rpmlib(CompressedFileNames) <= 3.0.4-1 rpmlib(FileDigests)
<= 4.6.0-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1
Requires: /usr/bin/pkg-config cmake-filesystem(x86-64)
libgandiva.so.1000()(64bit) pkgconfig(arrow)
Processing files: arrow9-python-libs-9.0.0.dev738-1.el8.x86_64
error: File not found:
/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/lib64/libarrow_python.so.*
Executing(%doc): /bin/sh -e /var/tmp/rpm-tmp.FezCIu
+ umask 022
+ cd /root/rpmbuild/BUILD
+ cd apache-arrow-9.0.0.dev738
+
DOCDIR=/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/share/doc/arrow9-python-libs
+ export LC_ALL=C
+ LC_ALL=C
+ export DOCDIR
+ /usr/bin/mkdir -p
/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/share/doc/arrow9-python-libs
+ cp -pr README.md
/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/share/doc/arrow9-python-libs
+ exit 0
Executing(%license): /bin/sh -e /var/tmp/rpm-tmp.4doqup
+ umask 022
+ cd /root/rpmbuild/BUILD
+ cd apache-arrow-9.0.0.dev738
+
LICENSEDIR=/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/share/licenses/arrow9-python-libs
+ export LC_ALL=C
+ LC_ALL=C
+ export LICENSEDIR
+ /usr/bin/mkdir -p
/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/share/licenses/arrow9-python-libs
+ cp -pr LICENSE.txt
/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/share/licenses/arrow9-python-libs
+ cp -pr NOTICE.txt
/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/share/licenses/arrow9-python-libs
+ exit 0
Directory not found:
/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/include/arrow/python
RPM build errors:
File not found:
/root/rpmbuild/BUILDROOT/arrow-9.0.0.dev738-1.el8.x86_64/usr/lib64/libarrow_python.so.*
Failed ./build.sh
rake aborted!
```
</details>
[Link to the
log](https://github.com/ursacomputing/crossbow/runs/7963525652?check_suite_focus=true#step:6:4710)
**conda-linux, conda-osx and conda-win**
---
Not really sure what is going on here (passes for conda-osx-arm64).
After pyarrow is built, on the step of [compiling .pyc
files](https://dev.azure.com/ursacomputing/crossbow/_build/results?buildId=31969&view=logs&j=0da5d1d9-276d-5173-c4c4-9d4d4ed14fdb&t=d9b15392-e4ce-5e4c-0c8c-b69645229181&l=4631),
there is a warning that `libarrow_python` and `libarrow_python_flight` are not
found - looks like an issue with `RPATH:`
```
WARNING
(pyarrow,lib/python3.10/site-packages/pyarrow/libarrow_python_flight.so.1000):
$RPATH/libarrow_python.so.1000 not found in packages, sysroot(s) nor the
missing_dso_whitelist.
.. is this binary repackaging?
```
Then `pyarrow-tests` are being built successfully but [fail after
that](https://dev.azure.com/ursacomputing/crossbow/_build/results?buildId=31953&view=logs&j=0da5d1d9-276d-5173-c4c4-9d4d4ed14fdb&t=d9b15392-e4ce-5e4c-0c8c-b69645229181&l=5479)
(due to `arrow_python` lib not being found).
<details>
<summary>conda-linux example log</summary>
<br>
```
...
export
PREFIX=/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol
export SRC_DIR=/build/arrow-cpp-ext_1661216150497/test_tmp
+ test -f
/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/include/arrow/api.h
+ test -f
/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/include/arrow/flight/types.h
+ test -f
/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/include/plasma/client.h
+ test -f
/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/include/gandiva/engine.h
+ test -f
/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/include/parquet/api/reader.h
+ test -f
/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/libarrow.so
+ test -f
/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/libarrow_dataset.so
+ test -f
/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/libarrow_flight.so
+ test -f
/build/arrow-cpp-ext_1661216150497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/libarrow_python.so
Tests failed for arrow-cpp-9.0.0.dev738-py310hf337226_0_cpu.tar.bz2 - moving
package to /build/broken
WARNING:conda_build.build:Tests failed for
arrow-cpp-9.0.0.dev738-py310hf337226_0_cpu.tar.bz2 - moving package to
/build/broken
TESTS FAILED: arrow-cpp-9.0.0.dev738-py310hf337226_0_cpu.tar.bz2
```
</details>
[Link to the
log](https://dev.azure.com/ursacomputing/crossbow/_build/results?buildId=31969&view=logs&j=0da5d1d9-276d-5173-c4c4-9d4d4ed14fdb&t=d9b15392-e4ce-5e4c-0c8c-b69645229181&l=5498)
**debian, ubuntu-focal and ubuntu-jammy (Crossbow) failures**
---
I think `dh_auto_clean` wants to remove `arrow_python` libs but can not
find them. Not sure why is it trying to remove them from Arrow cpp if they are
not built there anymore.
<details>
<summary>almalinkux example log</summary>
<br>
```
...
# Remove built files to reduce disk usage
dh_auto_clean \
--sourcedirectory=cpp \
--builddirectory=cpp_build
make[1]: Leaving directory '/build/apache-arrow-9.0.0.dev738'
dh_install
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/libarrow_python.so.*" (tried in ., debian/tmp)
dh_install: warning: libarrow-python1000 missing files:
usr/lib/*/libarrow_python.so.*
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/libarrow_python_flight.so.*" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-flight1000 missing files:
usr/lib/*/libarrow_python_flight.so.*
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/cmake/arrow/ArrowPythonConfig*.cmake" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-dev missing files:
usr/lib/*/cmake/arrow/ArrowPythonConfig*.cmake
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/cmake/arrow/ArrowPythonTargets*.cmake" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-dev missing files:
usr/lib/*/cmake/arrow/ArrowPythonTargets*.cmake
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/cmake/arrow/FindArrowPython.cmake" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-dev missing files:
usr/lib/*/cmake/arrow/FindArrowPython.cmake
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/libarrow_python.a" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-dev missing files:
usr/lib/*/libarrow_python.a
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/libarrow_python.so" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-dev missing files:
usr/lib/*/libarrow_python.so
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/pkgconfig/arrow-python.pc" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-dev missing files:
usr/lib/*/pkgconfig/arrow-python.pc
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/cmake/arrow/ArrowPythonFlightConfig*.cmake" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-flight-dev missing files:
usr/lib/*/cmake/arrow/ArrowPythonFlightConfig*.cmake
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/cmake/arrow/ArrowPythonFlightTargets*.cmake" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-flight-dev missing files:
usr/lib/*/cmake/arrow/ArrowPythonFlightTargets*.cmake
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/cmake/arrow/FindArrowPythonFlight.cmake" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-flight-dev missing files:
usr/lib/*/cmake/arrow/FindArrowPythonFlight.cmake
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/libarrow_python_flight.a" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-flight-dev missing files:
usr/lib/*/libarrow_python_flight.a
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/libarrow_python_flight.so" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-flight-dev missing files:
usr/lib/*/libarrow_python_flight.so
dh_install: warning: Cannot find (any matches for)
"usr/lib/*/pkgconfig/arrow-python-flight.pc" (tried in ., debian/tmp)
dh_install: warning: libarrow-python-flight-dev missing files:
usr/lib/*/pkgconfig/arrow-python-flight.pc
dh_install: error: missing files, aborting
make: *** [debian/rules:14: binary] Error 25
dpkg-buildpackage: error: debian/rules binary subprocess returned exit
status 2
debuild: fatal error at line 1182:
dpkg-buildpackage -us -uc -ui failed
Failed debuild -eCCACHE_COMPILERCHECK -eCCACHE_COMPRESS
-eCCACHE_COMPRESSLEVEL -eCCACHE_DIR -eCCACHE_MAXSIZE
--prepend-path=/usr/lib/ccache -us -uc
```
</details>
[Link to the
log](https://github.com/ursacomputing/crossbow/runs/7963617736?check_suite_focus=true#step:6:2391)
**homebrew failures**
---
Do not seem related (R test faillure).
**test-r failures**
---
Do not seem related (R test faillure).
**test-ubuntu failures**
---
Do not seem related (`substrait/function_test`).
**ubuntu-jammy Travis failures**
---
Do not seem related (looks like acero error).
**verify-rc-source failures**
---
Do not seem related (Arrow C++ test failures).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
