I was able to build with USE_CONDA=1 but that produced a long list of test
failures, which seems concerning?
17 - arrow-compute-internals-test (Failed)
18 - arrow-compute-expression-test (Failed)
19 - arrow-compute-scalar-cast-test (Failed)
20 - arrow-compute-scalar-type-test (Failed)
21 - arrow-compute-scalar-if-else-test (Failed)
22 - arrow-compute-scalar-temporal-test (Failed)
23 - arrow-compute-scalar-math-test (Failed)
24 - arrow-compute-scalar-utility-test (Failed)
25 - arrow-compute-vector-test (Failed)
26 - arrow-compute-aggregate-test (Failed)
27 - arrow-compute-kernel-utility-test (Failed)
28 - arrow-io-buffered-test (Failed)
29 - arrow-io-compressed-test (Failed)
30 - arrow-io-file-test (Failed)
33 - arrow-utility-test (Failed)
34 - arrow-async-utility-test (Failed)
41 - arrow-acero-order-by-node-test (Failed)
42 - arrow-acero-hash-join-node-test (Failed)
50 - arrow-cuda-test (Failed)
51 - arrow-dataset-dataset-test (Failed)
59 - arrow-dataset-file-csv-test (Failed)
60 - arrow-dataset-file-json-test (Failed)
65 - arrow-flight-internals-test (Failed)
66 - arrow-flight-test (Failed)
67 - arrow-flight-sql-test (Failed)
68 - arrow-flight-integration-test (Failed)
70 - arrow-ipc-json-simple-test (Failed)
71 - arrow-ipc-read-write-test (Failed)
72 - arrow-ipc-tensor-test (Failed)
74 - arrow-fixed-shape-tensor-test (Failed)
77 - parquet-reader-test (Failed)
78 - parquet-writer-test (Failed)
79 - parquet-arrow-test (Failed)
80 - parquet-arrow-internals-test (Failed)
83 - parquet-file-deserialize-test (Failed)
84 - parquet-schema-test (Failed)
85 - gandiva-internals-test (Failed)
87 - gandiva-filter-test (Failed)
88 - gandiva-projector-test (Failed)
93 - gandiva-binary-test (Failed)
94 - gandiva-date-time-test (Failed)
95 - gandiva-to-string-test (Failed)
99 - gandiva-null-validity-test (Failed)
ARROW_GANDIVA=0 and non conda worked fine though.
On Tue, Apr 25, 2023 at 11:50 PM Jacob Wujciak <ja...@voltrondata.com>
wrote:
> I checked out a trace for the cmake issue and LLVM 15.07 is found
> correctly. The issue come from `llvm_map_components_to_libnames` which
> complains about X86 not being in the lsit of libraries. But we don't add
> that but rather it gets appended in the function?
>
> /usr/lib/cmake/llvm/LLVM-Config.cmake(228):
> get_property(LLVM_TARGETS_CONFIGURED GLOBAL PROPERTY
> LLVM_TARGETS_CONFIGURED )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(234): if(NOT
> LLVM_TARGETS_CONFIGURED )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(244): list(FIND
> LLVM_TARGETS_TO_BUILD X86 have_native_backend )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(245): list(FIND link_components
> engine engine_required )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(246): if(NOT engine_required EQUAL
> -1 )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(255): list(FIND link_components
> native native_required )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(256): if(NOT native_required EQUAL
> -1 )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(257): if(NOT have_native_backend
> EQUAL -1 )
> */usr/lib/cmake/llvm/LLVM-Config.cmake(258): list(APPEND link_components
> X86 )*
> /usr/lib/cmake/llvm/LLVM-Config.cmake(263):
> llvm_expand_pseudo_components(link_components
> core;mcjit;native;ipo;bitreader;target;linker;analysis;debuginfodwarf;X86 )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(127): set(link_components
> core;mcjit;native;ipo;bitreader;target;linker;analysis;debuginfodwarf;X86 )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(128): foreach(c
> core;mcjit;native;ipo;bitreader;target;linker;analysis;debuginfodwarf;X86 )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(130): list(FIND
> LLVM_TARGETS_TO_BUILD core idx )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(131): if(NOT idx LESS 0 )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(159): elseif(c STREQUAL
> nativecodegen )
> [snip]
> /usr/lib/cmake/llvm/LLVM-Config.cmake(212): list(APPEND
> expanded_components debuginfodwarf )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(130): list(FIND
> LLVM_TARGETS_TO_BUILD X86 idx )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(131): if(NOT idx LESS 0 )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(132): if(TARGET LLVMX86CodeGen )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(134): else()
> /usr/lib/cmake/llvm/LLVM-Config.cmake(135): if(TARGET LLVMX86 )
> /usr/lib/cmake/llvm/LLVM-Config.cmake(137): else()
> */usr/lib/cmake/llvm/LLVM-Config.cmake(138): message(FATAL_ERROR Target
> X86 is not in the set of libraries. )*
>
> On Tue, Apr 25, 2023 at 10:57 AM Raúl Cumplido <raulcumpl...@gmail.com>
> wrote:
>
>> I have created the following issue for the new wheels test failure
>> around pandas 2.0.1 : https://github.com/apache/arrow/issues/35321
>>
>> I don't think we should create a new RC for that issue but I'm happy
>> to know other people's thoughts around that.
>>
>> El lun, 24 abr 2023 a las 21:12, Raúl Cumplido
>> (<raulcumpl...@gmail.com>) escribió:
>> >
>> > El lun, 24 abr 2023 a las 18:53, Will Jones
>> > (<will.jones...@gmail.com>) escribió:
>> > >
>> > > I'm seeing failing Pandas tests in PyArrow when verifying with
>> > >
>> > > USE_CONDA=1 dev/release/verify-release-candidate.sh 12.0.0 0
>> > >
>> > >
>> pyarrow/tests/test_extension_type.py::test_extension_to_pandas_storage_type[registered_period_type0]
>> > > - NotImplementedError: extension<test.period<PeriodType>>
>> >
>> > This is also happening on our nightlies from today:
>> >
>> https://github.com/ursacomputing/crossbow/actions/runs/4786502455/jobs/8510514881
>> >
>> > There has been a new pandas release: 2.0.1 around 9 hours ago which
>> > seems to be the causing issue:
>> > https://pypi.org/project/pandas/#history
>> >
>> > >
>> > > No one else is getting that?
>> > >
>> > >
>> > > On Sun, Apr 23, 2023 at 9:21 AM Raúl Cumplido <raulcumpl...@gmail.com
>> >
>> > > wrote:
>> > >
>> > > > +1 (non binding)
>> > > >
>> > > > I have tested both SOURCES and BINARIES successfully with:
>> > > > TEST_DEFAULT=0 TEST_SOURCE=1 dev/release/verify-release-candidate.sh
>> > > > 12.0.0 0
>> > > > TEST_DEFAULT=0 TEST_WHEELS=1 dev/release/verify-release-candidate.sh
>> > > > 12.0.0 0
>> > > > TEST_DEFAULT=0 TEST_BINARIES=1
>> dev/release/verify-release-candidate.sh
>> > > > 12.0.0 0
>> > > > with:
>> > > > * Python 3.10.6
>> > > > * gcc (Ubuntu 11.3.0-1ubuntu1~22.04) 11.3.0
>> > > > * NVIDIA CUDA cuda_11.5.r11.5/compiler.30672275_0
>> > > > * openjdk version "17.0.6" 2023-01-17
>> > > > * ruby 3.0.2p107 (2021-07-07 revision 0db68f0233)
>> [x86_64-linux-gnu]
>> > > > * dotnet 7.0.203
>> > > > * Ubuntu 22.04 LTS
>> > > >
>> > > > El dom, 23 abr 2023 a las 12:59, Yibo Cai (<yibo....@arm.com>)
>> escribió:
>> > > > >
>> > > > > +1
>> > > > >
>> > > > > I ran the followings on Ubuntu-22.04, aarch64.
>> > > > >
>> > > > > TEST_DEFAULT=0 \
>> > > > > TEST_CPP=1 \
>> > > > > TEST_PYTHON=1 \
>> > > > > TEST_GO=1 \
>> > > > > dev/release/verify-release-candidate.sh 12.0.0 0
>> > > > >
>> > > > > TEST_DEFAULT=0 \
>> > > > > TEST_WHEELS=1 \
>> > > > > dev/release/verify-release-candidate.sh 12.0.0 0
>> > > > >
>> > > > >
>> > > > > On 4/23/23 14:40, Sutou Kouhei wrote:
>> > > > > > +1
>> > > > > >
>> > > > > > I ran the followings on Debian GNU/Linux sid:
>> > > > > >
>> > > > > > * TEST_DEFAULT=0 \
>> > > > > > TEST_SOURCE=1 \
>> > > > > > LANG=C \
>> > > > > > TZ=UTC \
>> > > > > > CUDAToolkit_ROOT=/usr \
>> > > > > > ARROW_CMAKE_OPTIONS="-DBoost_NO_BOOST_CMAKE=ON
>> > > > -Dxsimd_SOURCE=BUNDLED" \
>> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0
>> > > > > >
>> > > > > > * TEST_DEFAULT=0 \
>> > > > > > TEST_APT=1 \
>> > > > > > LANG=C \
>> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0
>> > > > > >
>> > > > > > * TEST_DEFAULT=0 \
>> > > > > > TEST_BINARY=1 \
>> > > > > > LANG=C \
>> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0
>> > > > > >
>> > > > > > * TEST_DEFAULT=0 \
>> > > > > > TEST_JARS=1 \
>> > > > > > LANG=C \
>> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0
>> > > > > >
>> > > > > > * TEST_DEFAULT=0 \
>> > > > > > TEST_PYTHON_VERSIONS=3.11 \
>> > > > > > TEST_WHEELS=1 \
>> > > > > > LANG=C \
>> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0
>> > > > > >
>> > > > > > * TEST_DEFAULT=0 \
>> > > > > > TEST_YUM=1 \
>> > > > > > LANG=C \
>> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0
>> > > > > >
>> > > > > > with:
>> > > > > >
>> > > > > > * .NET SDK (6.0.406)
>> > > > > > * Python 3.11.2
>> > > > > > * gcc (Debian 12.2.0-14) 12.2.0
>> > > > > > * nvidia-cuda-dev 11.7.99~11.7.1-4
>> > > > > > * openjdk version "17.0.6" 2023-01-17
>> > > > > > * ruby 3.1.2p20 (2022-04-12 revision 4491bb740a)
>> [x86_64-linux-gnu]
>> > > > > >
>> > > > > >
>> > > > > > Thanks,
>> > > >
>>
>
