cloud-fan commented on PR #49027: URL: https://github.com/apache/spark/pull/49027#issuecomment-2528787572
So we are "guessing" the intention of the user-specified sort and re-ordering the sort keys so that the data clustering meets our requirement. I think this is dangerous. It looks safer just to restore the old behavior: we add a new sort node in `V1Writes` and that sort shouldn't be used to eliminate other sorts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
