[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194646#comment-14194646
]
Tom Arnfeld edited comment on SPARK-2691 at 11/3/14 3:56 PM:
-------------------------------------------------------------
Awesome. We're keen to get spark up and running on our cluster to share with
Hadoop so are going to be working on this now. Would anyone ([~yoeduardoj]?)
mind if we took this patch and made it a bit more fully featured (env
variables, pre 0.20 support, coarse mode) and opened a pull request to spark?
Just wondering how we can make this as frictionless as possible and not overlap
with any work you're doing on the patch. We're very keen to get this ready and
merged into the spark master branch.
was (Author: tarnfeld):
Awesome. We're keen to get spark up and running on our cluster to share with
Hadoop so are going to be working on this now. Would you mind if we took this
patch and made it a bit more fully featured (env variables, pre 0.20 support,
coarse mode) and opened a pull request to spark?
Just wondering how we can make this as frictionless as possible and not overlap
with any work you're doing on the patch. We're very keen to get this ready and
merged into the spark master branch.
> Allow Spark on Mesos to be launched with Docker
> -----------------------------------------------
>
> Key: SPARK-2691
> URL: https://issues.apache.org/jira/browse/SPARK-2691
> Project: Spark
> Issue Type: Improvement
> Components: Mesos
> Reporter: Timothy Chen
> Assignee: Timothy Chen
> Labels: mesos
> Attachments: spark-docker.patch
>
>
> Currently to launch Spark with Mesos one must upload a tarball and specifiy
> the executor URI to be passed in that is to be downloaded on each slave or
> even each execution depending coarse mode or not.
> We want to make Spark able to support launching Executors via a Docker image
> that utilizes the recent Docker and Mesos integration work.
> With the recent integration Spark can simply specify a Docker image and
> options that is needed and it should continue to work as-is.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
