[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194655#comment-14194655 ]
Eduardo Jimenez commented on SPARK-2691: ---------------------------------------- Go for it. It would be helpful if most of the possible mesos arguments are supported (see ContainerInfo in https://github.com/apache/mesos/blob/master/include/mesos/mesos.proto) One thing I was trying to do is create a set of common Mesos primitives, as the code to create ContainerInfo is going to be very similar for both fine-grained and coarse-grained mode. Just my $.02. > Allow Spark on Mesos to be launched with Docker > ----------------------------------------------- > > Key: SPARK-2691 > URL: https://issues.apache.org/jira/browse/SPARK-2691 > Project: Spark > Issue Type: Improvement > Components: Mesos > Reporter: Timothy Chen > Assignee: Timothy Chen > Labels: mesos > Attachments: spark-docker.patch > > > Currently to launch Spark with Mesos one must upload a tarball and specifiy > the executor URI to be passed in that is to be downloaded on each slave or > even each execution depending coarse mode or not. > We want to make Spark able to support launching Executors via a Docker image > that utilizes the recent Docker and Mesos integration work. > With the recent integration Spark can simply specify a Docker image and > options that is needed and it should continue to work as-is. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org