cloud-fan commented on pull request #31083: URL: https://github.com/apache/spark/pull/31083#issuecomment-758742427
> if someone does a manual global sort by (c1, c2) but the table requires a global sort by (c3, c4). Even though the manual sort will have no effect, we will still perform it. Very good point. Perhaps all other operators should add the required shuffle/sort at the optimizer if they can, but that's unrelated to this PR. Let's move forward with this approach and add more physical optimizations to remove unnecessary shuffle/sort later. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
