marin-ma commented on issue #10104: URL: https://github.com/apache/incubator-gluten/issues/10104#issuecomment-3109962019
> This issue has been resolved by using rss sort-based shuffle and this case only costs 74% of the cost time of vanilla version. Thank you so much for your help! @FelixYBW @marin-ma @NEUpanning Curious are you using RSS or not? The rss sort shuffle is only used for celeborn, but the flamegraph in the issue description shows it was not using rss for hash based shuffle. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
