[
https://issues.apache.org/jira/browse/SPARK-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621204#comment-14621204
]
Andrew Or commented on SPARK-6287:
----------------------------------
Note that this feature is not complete. The shuffle files are not currently
cleaned up when using Spark on Mesos with the external shuffle service. This
will be addressed separately in SPARK-8873.
> Add support for dynamic allocation in the Mesos coarse-grained scheduler
> ------------------------------------------------------------------------
>
> Key: SPARK-6287
> URL: https://issues.apache.org/jira/browse/SPARK-6287
> Project: Spark
> Issue Type: Improvement
> Components: Mesos
> Affects Versions: 1.2.0
> Reporter: Iulian Dragos
> Assignee: Iulian Dragos
> Fix For: 1.5.0
>
>
> Add support inside the coarse-grained Mesos scheduler for dynamic allocation.
> It amounts to implementing two methods that allow scaling up and down the
> number of executors:
> {code}
> def doKillExecutors(executorIds: Seq[String])
> def doRequestTotalExecutors(requestedTotal: Int)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
