Jiang Xingbo created SPARK-24954:
------------------------------------
Summary: Fail fast on job submit if run a barrier stage with
dynamic resource allocation enabled
Key: SPARK-24954
URL: https://issues.apache.org/jira/browse/SPARK-24954
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 2.4.0
Reporter: Jiang Xingbo
Since we explicitly listed "Support running barrier stage with dynamic resource
allocation" a Non-Goal in the design doc, we shall fail fast on job submit if
running a barrier stage with dynamic resource allocation enabled, to avoid some
confusing behaviors (can refer to SPARK-24942 for some examples).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]