[
https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747501#comment-16747501
]
Marco Gaido commented on SPARK-26639:
-------------------------------------
[~Jk_Self] I checked and there is only one subquery node in the plan. So I
can't see how can any subquery being executed more than once. Maybe the stages
you are checking are not the ones related to the subquery?
> The reuse subquery function maybe does not work in SPARK SQL
> ------------------------------------------------------------
>
> Key: SPARK-26639
> URL: https://issues.apache.org/jira/browse/SPARK-26639
> Project: Spark
> Issue Type: Improvement
> Components: SQL, Web UI
> Affects Versions: 2.3.2, 2.4.0
> Reporter: Ke Jia
> Priority: Major
>
> The subquery reuse feature has done in
> [https://github.com/apache/spark/pull/14548]
> In my test, I found the visualized plan do show the subquery is executed
> once. But the stage of same subquery execute maybe not once.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]