mcdull_zhang created SPARK-37652:
------------------------------------
Summary: Support optimize skewed join through union
Key: SPARK-37652
URL: https://issues.apache.org/jira/browse/SPARK-37652
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 3.2.0
Reporter: mcdull_zhang
`OptimizeSkewedJoin` rule will take effect only when the plan has two
ShuffleQueryStageExec。
With `Union`, it might break the assumption. For example, the following plans
{panel:title=scenes1:}
Union
SMJ
SMJ
{panel}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]