Jiang Xingbo created SPARK-24819:
------------------------------------
Summary: Fail fast when no enough slots to launch the barrier
stage on job submitted
Key: SPARK-24819
URL: https://issues.apache.org/jira/browse/SPARK-24819
Project: Spark
Issue Type: New Feature
Components: Spark Core
Affects Versions: 2.4.0
Reporter: Jiang Xingbo
Check all the barrier stages on job submitted, to see whether the barrier
stages require more slots (to be able to launch all the barrier tasks in the
same stage together) than currently active slots in the cluster. If the job
requires more slots than available (both busy and free slots), fail the job on
submit.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
