marin-ma opened a new pull request, #12499: URL: https://github.com/apache/gluten/pull/12499
Currently, gpu shuffle writer splits the boolean and timestamp vector to buffers that is same as arrow/cudf format because it assumes the shuffle reader stage will execute on GPU and use gpu shuffle reader. However, the stage execution is decided at runtime when AQE is on. If the next stage is planed to execute on CPU, the shuffle read will fail. In order to support a more general hybrid execution mode, it's necessary to unify the cpu/gpu shuffle writer output for a specific shuffle writer type (currently hash or sort). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
