Allison Wang created SPARK-33183:
------------------------------------
Summary: Bug in optimizer rule EliminateSorts
Key: SPARK-33183
URL: https://issues.apache.org/jira/browse/SPARK-33183
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.0.1, 3.0.0
Reporter: Allison Wang
Currently, the rule {{EliminateSorts}} removes a global sort node if its child
plan already satisfies the required sort order without checking if the child
plan's ordering is local or global. For example, in the following scenario, the
first sort shouldn't be removed because it has a stronger guarantee than the
second sort even if the sort orders are the same for both sorts.
{code:java}
Sort(orders, global = True, ...)
Sort(orders, global = False, ...){code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
