JacobZheng created SPARK-46588:
----------------------------------
Summary: Interrupt when executing ANALYSIS phase
Key: SPARK-46588
URL: https://issues.apache.org/jira/browse/SPARK-46588
Project: Spark
Issue Type: Question
Components: SQL
Affects Versions: 3.4.0
Reporter: JacobZheng
I have a long-running spark app on which I will start many tasks. When I am
executing complex tasks, I may spend a lot of time in the ANALYSIS phase or the
OPTIMIZATION phase or run into oom exceptions. I will cancel the task when
timeout is detected by calling cancelJobGroup method. However, the task is not
interrupted and the execution plan is still being generated. I{*}s there a way
to interrupt these phases?{*}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
