Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/17039
The code didn't respect the ordering because the analyzer adds a project on
top; this is for cases where you sort by a column that is not in the final
projection. We could also pattern match on that, but I don't think we should be
adding too much magic.
Let me merge this, and we can pick this up if it ever becomes an issue
again.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
