This is excellent proposal. We worked on apache arrow based native Spark SQL
engine offloading for 1.5 years. Currently we extended Gandiva's node and
expression definition to pass query plan from Spark to native code. We will try
start to try substrait. These features can definitely help:
(O)
The vote passes with
4 +1 (binding)
3 +1 (non binding)
The release is available here:
https://dist.apache.org/repos/dist/release/arrow/arrow-rs-6.0.0
The code has also been released to crates.io:
https://crates.io/crates/arrow/6.0.0
https://crates.io/crates/arrow-flight/6.0.0
https://crates.io/
