Niels Becker created SPARK-16755:
------------------------------------
Summary: Enable external shuffle service with Mesos Docker
Containers
Key: SPARK-16755
URL: https://issues.apache.org/jira/browse/SPARK-16755
Project: Spark
Issue Type: Improvement
Reporter: Niels Becker
When using Mesos with Docker it is not possible to use a external shuffle
service. This is because the external shuffle service is supposed to run on
localhost, which obviously is not the case for Docker containers.
If the Mesos Shuffle Service also runs inside a Docker Container we could
implement the Docker link option to tell Mesos to link both containers
together.
Otherwise if its running on the host, we could use the gateway address to
connect to the shuffle service.
Thoughts?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
