wuyi created SPARK-55970:
----------------------------
Summary: Cap spark.executor.cores to max worker cores when it's
set too large
Key: SPARK-55970
URL: https://issues.apache.org/jira/browse/SPARK-55970
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 4.2.0
Reporter: wuyi
Users may mistakenly set a wrong spark.executor.cores, which is large than any
of available core in all workers. And they'd be confused and complain where
there is no executor launched. This ticket proposes to automactillay cap the
wrong setting to the max available cores of all the workers so that executor is
able to launch.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
