[
https://issues.apache.org/jira/browse/ARROW-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265158#comment-17265158
]
Jeroen commented on ARROW-11217:
--------------------------------
I tried building without jemalloc but now it crashes somewhere else
{code}
Thread 0 Crashed:: Dispatch queue: com.apple.main-thread
0 <translation info unavailable> 0x00000001020ba420 ???
1 arrow.so 0x0000000110316904
arrow::BooleanArray::BooleanArray(std::__1::shared_ptr<arrow::ArrayData>
const&) + 24
2 arrow.so 0x0000000110316904
arrow::BooleanArray::BooleanArray(std::__1::shared_ptr<arrow::ArrayData>
const&) + 24
3 arrow.so 0x000000011034ee12 arrow::Status
arrow::internal::ArrayDataWrapper::Visit<arrow::BooleanType>(arrow::BooleanType
const&) + 76
4 arrow.so 0x0000000110348d90 arrow::Status
arrow::VisitTypeInline<arrow::internal::ArrayDataWrapper>(arrow::DataType
const&, arrow::internal::ArrayDataWrapper*) + 95
5 arrow.so 0x0000000110348cfe
arrow::MakeArray(std::__1::shared_ptr<arrow::ArrayData> const&) + 46
6 arrow.so 0x000000011037aad0
arrow::Datum::make_array() const + 24
7 arrow.so 0x000000011014774a
from_datum(arrow::Datum) + 202 (compute.cpp:138)
8 arrow.so 0x0000000110148987
compute__CallFunction(std::__1::basic_string<char, std::__1::char_traits<char>,
std::__1::allocator<char> >, cpp11::r_vector<SEXPREC*>,
cpp11::r_vector<SEXPREC*>) + 599 (compute.cpp:224)
9 arrow.so 0x0000000110110466
_arrow_compute__CallFunction + 150 (arrowExports.cpp:1189)
{code}
Maybe we should ignore this for now, perhaps there is a problem with R or llvm
when when it runs under rosetta. It does feel like a memory corruption in the
arrow compute functionality, but I'm having a bit of hard time debugging this
as it only happens under the emulator.
> [C++][R] Crash under Rosetta when running a Sum kernel
> ------------------------------------------------------
>
> Key: ARROW-11217
> URL: https://issues.apache.org/jira/browse/ARROW-11217
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Reporter: Neal Richardson
> Priority: Critical
> Fix For: 3.0.0
>
>
> [~jeroenooms] hit a crash in the "sum" compute kernel using the R package on
> a new M1 machine running the rosetta emulator:
> https://gist.github.com/jeroen/c60548b29ff7f6807a6554799bd01cb7
> According to
> https://developer.apple.com/documentation/apple_silicon/about_the_rosetta_translation_environment,
> we should be checking sysctlbyname for AVX* capabilities, but we are not. We
> only use that function in
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/util/cpu_info.cc#L350-L359
> to check cpu cache size.
> This may also explain a crash we observed previously on a very old macOS CRAN
> machine.
> I think we should to resolve this before the 3.0 release if possible, in
> order to avoid bug reports as more people get M1s.
> cc [~apitrou] [~uwe] [~kou] [~frankdu] [~yibo]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
