Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14842
Ok, so ASCENDING and DESCENDING have different NULLS behavior:
- ASCENDING: NULLS FIRST
- DESCENDING: NULLS LAST
I really like to avoid `nulls` being passed around and I also like to avoid
a third case we need to deal with. My suggestion would be:
- Only deal with the ASC NULLS FIRST/ASC NULLS LAST/DESC NULLS FIRST/DESC
NULL LAST scenarios in prefix sort (and to drop the null scenario).
- Encode the null default behavior in the `SortDirection` and make the
default nullOrdering parameter in `SortOrder` use that.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
