WangTaoTheTonic created SPARK-5336:
--------------------------------------
Summary: spark.executor.cores must not be less than spark.task.cpus
Key: SPARK-5336
URL: https://issues.apache.org/jira/browse/SPARK-5336
Project: Spark
Issue Type: Bug
Components: YARN
Reporter: WangTaoTheTonic
If user set spark.executor.cores to be less than spark.task.cpus, task
scheduler will fall in infinite loop, we should throw an exception.in that case.
In standalone and mesos mode, we should respect spark.task.cpus too, and I will
file another JIRA to solve that.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]