zhztheplayer opened a new issue, #6920: URL: https://github.com/apache/incubator-gluten/issues/6920
### Description Currently only only single backend can be used in Gluten. This topic suggests a plug-able system to allow enabling multiple backends at compile time. For example, eventually one could build Gluten with `-P backends-velox,backends-another` to enable both Velox backend and `another` backend that could possibly be added to Gluten code base in future. In the case when a query is being run, Gluten's query planner could choose the best path to implement the physical plan that may be a mixing of Velox sub-plans and `another` sub-plans. The feature could drive Gluten to evolve from a hand-written middle layer to a development platform to offload Spark SQL with different data formats, acceleration libraries, or hardware architectures. Prior to doing this, a bunch of preparation work should be done including essential code refactors. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
