Niels Becker created SPARK-16755: ------------------------------------ Summary: Enable external shuffle service with Mesos Docker Containers Key: SPARK-16755 URL: https://issues.apache.org/jira/browse/SPARK-16755 Project: Spark Issue Type: Improvement Reporter: Niels Becker
When using Mesos with Docker it is not possible to use a external shuffle service. This is because the external shuffle service is supposed to run on localhost, which obviously is not the case for Docker containers. If the Mesos Shuffle Service also runs inside a Docker Container we could implement the Docker link option to tell Mesos to link both containers together. Otherwise if its running on the host, we could use the gateway address to connect to the shuffle service. Thoughts? -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org