Charles Allen created SPARK-12248:
-------------------------------------
Summary: Make Spark Coarse Mesos Scheduler obey limits on
memory/cpu ratios
Key: SPARK-12248
URL: https://issues.apache.org/jira/browse/SPARK-12248
Project: Spark
Issue Type: Improvement
Components: Mesos
Reporter: Charles Allen
It is possible to have spark apps that work best with either more memory or
more CPU.
In a multi-tenant environment (such as Mesos) it can be very beneficial to be
able to limit the Coarse scheduler to guarantee an executor doesn't subscribe
to too many cpus or too much memory.
This ask is to add functionality to the Coarse Mesos Scheduler to have basic
limits to the ratio of memory to cpu, which default to the current behavior of
soaking up whatever resources it can.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
