StefanXiepj commented on pull request #32925: URL: https://github.com/apache/spark/pull/32925#issuecomment-862097727
> Is there a way we can benchmark the before and after to validate the avoided shuffle? Or if it was done already at least manually, somehow have the unit test expose the resulting difference? @dgd-contributor have benchmarked it. https://issues.apache.org/jira/browse/SPARK-35622?focusedCommentId=17363336&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17363336 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
