Takuya Ueshin created SPARK-39419:
-------------------------------------
Summary: When the comparator of ArraySort returns null, it should
fail.
Key: SPARK-39419
URL: https://issues.apache.org/jira/browse/SPARK-39419
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.3.0
Reporter: Takuya Ueshin
When the comparator of {{ArraySort}} returns {{null}}, currently it handles it
as {{0}} (equal).
According to the doc,
{quote}
It returns -1, 0, or 1 as the first element is less than, equal to, or greater
than the second element. If the comparator function returns other values
(including null), the function will fail and raise an error.
{quote}
It's fine to return non -1, 0, 1 integers to follow the Java convention (still
need to update the doc, though), but it should throw an exception for {{null}}
result.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
