Timothy Chen created SPARK-9873:
-----------------------------------
Summary: Cap the amount of executors launched in Mesos fine grain
mode
Key: SPARK-9873
URL: https://issues.apache.org/jira/browse/SPARK-9873
Project: Spark
Issue Type: Improvement
Components: Mesos
Reporter: Timothy Chen
Currently in fine grain mode as long as there is resources available that
matches the scheduler requirement Spark will try to use the resources offered
by mesos, which means to excessive resource usage that can lead to other
frameworks not able to get their fair share.
We should add a option to cap the number of executors launched, so the
combination of spark.task.cpus and spark.mesos.executor.max is the total amount
of cores it will grab.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
