frmnboi commented on issue #10488:
URL: https://github.com/apache/arrow/issues/10488#issuecomment-861180963


   After running python with debug symbols in GDB, Here is the relevant part of 
the GDB backtrace with directory names redacted:
   
   ```
   #0  __memmove_avx_unaligned_erms () at 
../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S:314
   #1  0x00007fffcf18a9d2 in arrow::BufferBuilder::UnsafeAppend 
(this=0x7fffffffd100, data=0x7fffffffcff0, length=8)
       at 
SOURCEPATH/Python_venv_3.8.5/lib/python3.8/site-packages/pyarrow/include/arrow/buffer_builder.h:136
   #2  0x00007fffcf195871 in arrow::TypedBufferBuilder<double, 
void>::UnsafeAppend (this=0x7fffffffd100, 
       value=0.10351288056206089)
       at 
SOURCEPATH/Python_venv_3.8.5/lib/python3.8/site-packages/pyarrow/include/arrow/buffer_builder.h:232
   #3  0x00007fffcf1902c0 in 
arrow::NumericBuilder<arrow::DoubleType>::UnsafeAppend (this=0x7fffffffd070, 
       val=0.10351288056206089)
       at 
SOURCEPATH/Python_venv_3.8.5/lib/python3.8/site-packages/pyarrow/include/arrow/array/builder_primitive.h:265
   #4  0x00007fffcf18b455 in vol_adj_close (close=..., volume=...)
       at CODEPATH/Database/helperfuncs.cpp:94
   ```
   
   in addition to:
   
   
   ```
   Thread 1 "python" received signal SIGSEGV, Segmentation fault.
   __memmove_avx_unaligned_erms () at 
../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S:314
   314  ../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S: No such file 
or directory.
   
   ```
   
   As suspected, the issue is in **UnsafeAppend**, but I'm not sure why this 
file is missing in my install/system.  Do I need to build pyarrow from source 
to get this to install?  It looks like it is a reference to an X86 AVX-512 SIMD 
command, as referenced 
[here](https://arrow.apache.org/docs/format/Columnar.html?highlight=avx).  The 
missing file in question can presumably be found publicly online at places like 
[this](https://sources.debian.org/src/glibc/2.28-10/sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S/).
  I think part of the problem may be that I have a 3rd gen Ryzen processor, 
which according to some reports does not support AVX-512.  I can't really tell 
if it isn't working because of hardware limitations, or because the capability 
and file exists, but I am not linking all the dependencies I need.  


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to