[
https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411309#comment-15411309
]
Michael Gummelt commented on SPARK-16944:
-----------------------------------------
Since Mesos is offer based, it's up to the Spark scheduler itself to choose
which offers have the best locality. In YARN, I think they tell the resource
manager about preferences.
> [MESOS] Improve data locality when launching new executors when dynamic
> allocation is enabled
> ---------------------------------------------------------------------------------------------
>
> Key: SPARK-16944
> URL: https://issues.apache.org/jira/browse/SPARK-16944
> Project: Spark
> Issue Type: New Feature
> Components: Mesos
> Affects Versions: 2.0.0
> Reporter: Sun Rui
>
> Currently Spark on Yarn supports better data locality by considering the
> preferred locations of the pending tasks when dynamic allocation is enabled.
> Refer to https://issues.apache.org/jira/browse/SPARK-4352. It would be better
> that Mesos can also support this feature.
> I guess that some logic existing in Yarn could be reused by Mesos.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
