[
https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-4286:
--------------------------------
Description:
With the new external shuffle service added, we need to also make the Mesos
integration able to launch the shuffle service and support the auto scaling
executors.
Mesos executor will launch the external shuffle service and leave it running,
while have spark executors scalable.
was:With the new external shuffle service added, we need to also make the
Mesos integration able to launch the shuffle service and support the auto
scaling executors.
> Support External Shuffle Service with Mesos integration
> -------------------------------------------------------
>
> Key: SPARK-4286
> URL: https://issues.apache.org/jira/browse/SPARK-4286
> Project: Spark
> Issue Type: Task
> Components: Mesos
> Reporter: Timothy Chen
>
> With the new external shuffle service added, we need to also make the Mesos
> integration able to launch the shuffle service and support the auto scaling
> executors.
> Mesos executor will launch the external shuffle service and leave it running,
> while have spark executors scalable.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
