frmnboi commented on issue #10488: URL: https://github.com/apache/arrow/issues/10488#issuecomment-861180963
After running python with debug symbols in GDB, Here is the relevant part of the GDB backtrace with directory names redacted: ``` #0 __memmove_avx_unaligned_erms () at ../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S:314 #1 0x00007fffcf18a9d2 in arrow::BufferBuilder::UnsafeAppend (this=0x7fffffffd100, data=0x7fffffffcff0, length=8) at SOURCEPATH/Python_venv_3.8.5/lib/python3.8/site-packages/pyarrow/include/arrow/buffer_builder.h:136 #2 0x00007fffcf195871 in arrow::TypedBufferBuilder<double, void>::UnsafeAppend (this=0x7fffffffd100, value=0.10351288056206089) at SOURCEPATH/Python_venv_3.8.5/lib/python3.8/site-packages/pyarrow/include/arrow/buffer_builder.h:232 #3 0x00007fffcf1902c0 in arrow::NumericBuilder<arrow::DoubleType>::UnsafeAppend (this=0x7fffffffd070, val=0.10351288056206089) at SOURCEPATH/Python_venv_3.8.5/lib/python3.8/site-packages/pyarrow/include/arrow/array/builder_primitive.h:265 #4 0x00007fffcf18b455 in vol_adj_close (close=..., volume=...) at CODEPATH/Database/helperfuncs.cpp:94 ``` in addition to: ``` Thread 1 "python" received signal SIGSEGV, Segmentation fault. __memmove_avx_unaligned_erms () at ../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S:314 314 ../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S: No such file or directory. ``` As suspected, the issue is in **UnsafeAppend**, but I'm not sure why this file is missing in my install/system. Do I need to build pyarrow from source to get this to install? It looks like it is a reference to an X86 AVX-512 SIMD command, as referenced [here](https://arrow.apache.org/docs/format/Columnar.html?highlight=avx). The missing file in question can presumably be found publicly online at places like [this](https://sources.debian.org/src/glibc/2.28-10/sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S/). I think part of the problem may be that I have a 3rd gen Ryzen processor, which according to some reports does not support AVX-512. I can't really tell if it isn't working because of hardware limitations, or because the capability and file exists, but I am not linking all the dependencies I need. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org