I don't know the answer per se but my understanding is that Arrow enables ccmputational kernels that can be highly optimized. I plan to do some work in this direction myself.
- Daniel Hi, > > I wonder if anyone can comment on how does Apache Arrow accomplish, or help > accomplish the following, taken from the Apache page > <http://arrow.apache.org/>: > > Apache Arrow™ enables execution engines to take advantage of the latest > SIMD (Single input multiple data) operations included in modern processors, > for native vectorized optimization of analytical data processing. Columnar > layout is optimized for data locality for better performance on modern > hardware like CPUs and GPUs. > > The Arrow memory format supports *zero-copy reads* for lightning-fast data > access without serialization overhead. > Can anyone provide information concerning how the standard specifically > helps with those concerns, in particular the ones highlighted above? > > Disclaimer: I've not read the source or the source of the related repos. > > Many thanks! > Matan >
