GitHub user wjunLu edited a discussion: Add a new backend: Omni

### What is Omni?
Our team has developed a series of deeply optimized acceleration libraries on 
ARM platforms. As part of these works, we forked the Gluten project and added a 
new backend called `omni`. 

This [forked repository](https://gitee.com/kunpeng_compute/gluten) follows the 
examples of the `Velox` and `ClickHouse` backends by adding an `omni` backend 
adaptation `backends-omni` and a native adaptation `cpp-omni` to integrate with 
OmniOperator acceleration library (currently in the open-source process).

### How to maintain this feature?
If the Gluten community is willing to merge the omni adaptation, our team has a 
dedicated group that can take responsibility for maintaining this feature, 
ensuring its long-term evolution, and providing corresponding ARM CI resources 
for build validation.

### Performance
- The OmniOperator achieves an average performance improvement of over 70% in 
Spark, on TPC-DS 99 benchmark test cases.
<img width="560" height="318" alt="图片 2" 
src="https://github.com/user-attachments/assets/1338eb62-f5a9-4cee-a27e-c93f41e6b441";
 />


- The OmniOperator achieves an average performance improvement of over 20% in 
Hive, on TPC-DS 99 benchmark test cases.

(seconds)
<img width="1918" height="537" alt="图片 3" 
src="https://github.com/user-attachments/assets/94fc36bd-7660-45f5-b3e7-decf53a351b1";
 />



GitHub link: https://github.com/apache/incubator-gluten/discussions/10188

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to