[
https://issues.apache.org/jira/browse/SPARK-16755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niels Becker resolved SPARK-16755.
----------------------------------
Resolution: Not A Problem
> Enable external shuffle service with Mesos Docker Containers
> ------------------------------------------------------------
>
> Key: SPARK-16755
> URL: https://issues.apache.org/jira/browse/SPARK-16755
> Project: Spark
> Issue Type: Improvement
> Reporter: Niels Becker
>
> When using Mesos with Docker it is not possible to use a external shuffle
> service. This is because the external shuffle service is supposed to run on
> localhost, which obviously is not the case for Docker containers.
> If the Mesos Shuffle Service also runs inside a Docker Container we could
> implement the Docker link option to tell Mesos to link both containers
> together.
> Otherwise if its running on the host, we could use the gateway address to
> connect to the shuffle service.
> Thoughts?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
