zhztheplayer opened a new issue, #8060:
URL: https://github.com/apache/incubator-gluten/issues/8060

   ### Description
   
   Part of https://github.com/apache/incubator-gluten/issues/6920.
   
   So far Gluten's native shuffle implementations, including VL, CH, VL + RSS 
are activated by specifying corresponding shuffle manager types in Spark 
configuration. 
   
   However if we want to mix different native shuffles in the same query plan, 
as Spark only allows one shuffle manager to be registered (see also a related 
[SPIP](https://issues.apache.org/jira/browse/SPARK-45792?jql=project%20%3D%20SPARK%20AND%20resolution%20%3D%20Unresolved%20AND%20text%20~%20spip%20ORDER%20BY%20created%20DESC%2C%20priority%20DESC%2C%20updated%20DESC))
 yet, we should enhance this way by providing a registry of native shuffles. 
Then query planner could choose a optimal one among all the candidates.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to