Jongyoul Lee created SPARK-6350:
-----------------------------------
Summary: make mesosExecutorCores configurable in mesos
"fine-grained" mode
Key: SPARK-6350
URL: https://issues.apache.org/jira/browse/SPARK-6350
Project: Spark
Issue Type: Improvement
Reporter: Jongyoul Lee
Priority: Minor
When spark runs in mesos fine-grained mode, mesos slave launches executor with
# of cpus and memories. By the way, # of executor's cores is always
CPU_PER_TASKS as same as spark.task.cpus. If I set that values as 5 for running
intensive task, mesos executor always consume 5 cores without any running task.
This waste resources. We should set executor core as a configuration variable.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
