alamb commented on issue #2122:
URL:
https://github.com/apache/arrow-datafusion/issues/2122#issuecomment-1147404652
datafusion `PhysicalExpr` and `arrow-rs` library currently evaluate
expressions by "materializing intermediate results" -- for example `(a + b) +
c` results in first evaluating `(a+b)` to a temporary location and then adding
`c` to form the final result.
Note however, there is a tradeoff here between the speed gained using the
LLVM optimized vectorized kernels in `arrow-rs` and cranelift generated JIT
expressions where JIT may not actually be faster. I think this is what
@Dandandan is referring to when he says "allow for possible use of SIMD
instructions, either explicitly by instrumenting cranelift enough or through
auto-vectorization."
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
