[ 
https://issues.apache.org/jira/browse/SPARK-47459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yuming Wang updated SPARK-47459:
--------------------------------
    Attachment: task stack trace.png

> Cancel running stage if the result is empty relation
> ----------------------------------------------------
>
>                 Key: SPARK-47459
>                 URL: https://issues.apache.org/jira/browse/SPARK-47459
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.5.1
>            Reporter: Yuming Wang
>            Priority: Major
>         Attachments: task stack trace.png
>
>
> How to reproduce:
> bin/spark-sql --master yarn --conf spark.driver.host=10.211.174.53
> {code:sql}
> set spark.sql.adaptive.enabled=true;
> select a from (select id as a, id as b, id as z from range(100000000)) t1
> join (select id as c, id as d from range(200000000)) t2 on t1.a = t2.c
> join (select id as e, id as f from range(300000000)) t3 on t2.d = t3.e
> where z % 10 < 0
> group by 1;
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to