XiDuo You created SPARK-35442:
---------------------------------
Summary: Eliminate unnecessary join through Aggregate
Key: SPARK-35442
URL: https://issues.apache.org/jira/browse/SPARK-35442
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: XiDuo You
If Aggregate and Join has the same output partitioning, the plan will look like
{code:java}
SortMergeJoin
Sort
HashAggregate
Shuffle
Sort
xxx{code}
To imporve the `EliminateUnnecessaryJoin`, we can support this case.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
