[
https://issues.apache.org/jira/browse/SPARK-46428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17797994#comment-17797994
]
Tongwei commented on SPARK-46428:
---------------------------------
cc [~yumwang]
> The stage that retries due to FetchFailed will cause the downstream skewJoin
> AQE become ineffective
> ---------------------------------------------------------------------------------------------------
>
> Key: SPARK-46428
> URL: https://issues.apache.org/jira/browse/SPARK-46428
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.5.0
> Reporter: Tongwei
> Priority: Major
> Attachments: Stage 46.0 skewjoin apply failed.png, Stage 46.0
> skewjoin apply success.png
>
>
> In our production environment, a SQL statement containing a Union all was
> executed. Due to a FetchFailed issue in Stage 24.0 of the first Union
> subquery, after rerunning some stages, Stage 46.0, which was supposed to
> follow the Skew Join rule, is now unable to take effect.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
