frmnboi commented on issue #10488:
URL: https://github.com/apache/arrow/issues/10488#issuecomment-861180963
After running python with debug symbols in GDB, Here is the relevant part of
the GDB backtrace with directory names redacted:
```
#0 __memmove_avx_unaligned_erms () at
../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S:314
#1 0x00007fffcf18a9d2 in arrow::BufferBuilder::UnsafeAppend
(this=0x7fffffffd100, data=0x7fffffffcff0, length=8)
at
SOURCEPATH/Python_venv_3.8.5/lib/python3.8/site-packages/pyarrow/include/arrow/buffer_builder.h:136
#2 0x00007fffcf195871 in arrow::TypedBufferBuilder<double,
void>::UnsafeAppend (this=0x7fffffffd100,
value=0.10351288056206089)
at
SOURCEPATH/Python_venv_3.8.5/lib/python3.8/site-packages/pyarrow/include/arrow/buffer_builder.h:232
#3 0x00007fffcf1902c0 in
arrow::NumericBuilder<arrow::DoubleType>::UnsafeAppend (this=0x7fffffffd070,
val=0.10351288056206089)
at
SOURCEPATH/Python_venv_3.8.5/lib/python3.8/site-packages/pyarrow/include/arrow/array/builder_primitive.h:265
#4 0x00007fffcf18b455 in vol_adj_close (close=..., volume=...)
at CODEPATH/Database/helperfuncs.cpp:94
```
in addition to:
```
Thread 1 "python" received signal SIGSEGV, Segmentation fault.
__memmove_avx_unaligned_erms () at
../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S:314
314 ../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S: No such file
or directory.
```
As suspected, the issue is in **UnsafeAppend**, but I'm not sure why this
file is missing in my install/system. Do I need to build pyarrow from source
to get this to install? It looks like it is a reference to an X86 AVX-512 SIMD
command, as referenced
[here](https://arrow.apache.org/docs/format/Columnar.html?highlight=avx). The
missing file in question can presumably be found publicly online at places like
[this](https://sources.debian.org/src/glibc/2.28-10/sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S/).
I think part of the problem may be that I have a 3rd gen Ryzen processor,
which according to some reports does not support AVX-512. I can't really tell
if it isn't working because of hardware limitations, or because the capability
and file exists, but I am not linking all the dependencies I need.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
