Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

6:20 PM To: Dave Ariens Cc: Tim Chen; Olivier Girardot; user@spark.apache.org Subject: Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos On Fri, Jun 26, 2015 at 3:09 PM, Dave Ariens mailto:dari...@blackberry.com>> wrote: Would there be any way to have the task instances in

Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

On Fri, Jun 26, 2015 at 3:09 PM, Dave Ariens wrote: > Would there be any way to have the task instances in the slaves call the > UGI login with a principal/keytab provided to the driver? > That would only work with a very small number of executors. If you have many login requests in a short per

Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

stances in the slaves call the UGI login with a principal/keytab provided to the driver? From: Marcelo Vanzin Sent: Friday, June 26, 2015 5:28 PM To: Tim Chen Cc: Olivier Girardot; Dave Ariens; user@spark.apache.org Subject: Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos On F

Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

On Fri, Jun 26, 2015 at 2:08 PM, Tim Chen wrote: > Mesos do support running containers as specific users passed to it. > Thanks for chiming in, what else does YARN do with Kerberos besides keytab > file and user? > The basic things I'd expect from a system to properly support Kerberos would be:

Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

Mesos do support running containers as specific users passed to it. Thanks for chiming in, what else does YARN do with Kerberos besides keytab file and user? Tim On Fri, Jun 26, 2015 at 1:20 PM, Marcelo Vanzin wrote: > On Fri, Jun 26, 2015 at 1:13 PM, Tim Chen wrote: > >> So correct me if I'm

Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

iday, June 26, 2015 4:20 PM To: Tim Chen Cc: Olivier Girardot; Dave Ariens; user@spark.apache.org Subject: Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos On Fri, Jun 26, 2015 at 1:13 PM, Tim Chen mailto:t...@mesosphere.io>> wrote: So correct me if I'm wrong, sounds l

Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

On Fri, Jun 26, 2015 at 1:13 PM, Tim Chen wrote: > So correct me if I'm wrong, sounds like all you need is a principal user > name and also a keytab file downloaded right? > I'm not familiar with Mesos so don't know what kinds of features it has, but at the very least it would need to start cont

Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

rote: > I would pretty much need exactly this kind of feature too > > Le ven. 26 juin 2015 à 21:17, Dave Ariens a > écrit : > >> Hi Timothy, >> >> >> >> Because I'm running Spark on Mesos alongside a secured Hadoop cluster, I >> need to e

Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

I would pretty much need exactly this kind of feature too Le ven. 26 juin 2015 à 21:17, Dave Ariens a écrit : > Hi Timothy, > > > > Because I'm running Spark on Mesos alongside a secured Hadoop cluster, I > need to ensure that my tasks running on the slaves perform a

RE: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

Hi Timothy, Because I'm running Spark on Mesos alongside a secured Hadoop cluster, I need to ensure that my tasks running on the slaves perform a Kerberos login before accessing any HDFS resources. To login, they just need the name of the principal (username) and a keytab file. Then

Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos

p resources in Spark > only works when running Spark on YARN. However, I'd really like to hack > something together for Spark on Mesos running alongside a secured Hadoop > cluster. My simplified appplication (gist: > https://gist.github.com/ariens/2c44c30e064b1790146a) receives a K

Accessing Kerberos Secured HDFS Resources from Spark on Mesos

I understand that Kerberos support for accessing Hadoop resources in Spark only works when running Spark on YARN. However, I'd really like to hack something together for Spark on Mesos running alongside a secured Hadoop cluster. My simplified appplication (gist: https://gist.githu

Spark on Mesos fine-grained - has one core less per executor

I'm doing a performance analysis for Spark on Mesos and I can see that the Coarse-grained backend simply launches tasks in wave size of the amount of cores available. But it seems Fine-grained mode the Mesos executor takes 1 core for itself (so -1 core per mesos slave). Shouldn't fine-

Re: Spark on Mesos vs Yarn

A follow up : considering that spark on mesos is indeed important to databricks, its partners and the community, fundamental issues like spark-6284 shouldn't be languishing for this long. A mesos cluster hosting diverse (i.e.multi-tenant) workloads is a common scenario in production for se

Re: Spark on Mesos vs Yarn

Hi Ankur, Just to add a thought to Tim's excellent answer, Spark on Mesos is very important to us and is the recommended deployment for our customers as Typesafe. Thanks for pointing to your PR, I see Tim already went through a round of reviews. It seems very useful, I'll give it a t

Re: Spark on Mesos vs Yarn

e some links to the JIRA and pull requests so that I can keep track on the progress/features. Again, thanks for replying. - -- Ankur Chauhan On 15/05/2015 00:39, Tim Chen wrote: > Hi Ankur, > > This is a great question as I've heard similar concerns about Spark > on Mesos. &g

Re: Spark on Mesos vs Yarn

Hi Ankur, This is a great question as I've heard similar concerns about Spark on Mesos. At the time when I started to contribute to Spark on Mesos approx half year ago, the Mesos scheduler and related code hasn't really got much attention from anyone and it was pretty much in mainte

Spark on Mesos vs Yarn

assume that spark on mesos is more or less a dead or something like a maintenance-only feature and YARN is the recommended way to go? What is the roadmap for spark on mesos? and what is the roadmap for spark on yarn. I like mesos so as much as I would like to see it thrive I don't think

Re: Spark on Mesos

Yup, exactly as Tim mentioned on it too. I went back and tried what you just suggested and that was also perfectly fine. Steve On May 13, 2015, at 1:58 PM, Tim Chen mailto:t...@mesosphere.io>> wrote: Hi Stephen, You probably didn't run the Spark driver/shell as root, as Mesos scheduler will

Re: Spark on Mesos

Hi Stephen, You probably didn't run the Spark driver/shell as root, as Mesos scheduler will pick up your local user and tries to impersonate as the same user and chown the directory before executing any task. If you try to run Spark driver as root it should resolve the problem. No switch user can

Re: Spark on Mesos

Sander, I eventually solved this problem via the --[no-]switch_user flag, which is set to true by default. I set this to false, which would have the user that owns the process run the job, otherwise it was my username (scarman) running the job, which would fail because obviously my username didn

Re: Spark on Mesos

Hey all, I seem to be experiencing the same thing as Stephen. I run Spark 1.2.1 with Mesos 0.22.1, with Spark coming from the spark-1.2.1-bin-hadoop2.4.tgz prebuilt package, and Mesos installed from the Mesosphere repositories. I have been running with Spark standalone successfully for a while and

Re: Spark on Mesos

Hi Stephen, It looks like Mesos slave was most likely not able to launch some mesos helper processes (fetcher probably?). How did you install Mesos? Did you build from source yourself? Please install Mesos through a package or actually from source run make install and run from the installed bina

Re: Spark on Mesos

So I installed spark on each of the slaves 1.3.1 built with hadoop2.6 I just basically got the pre-built from the spark website… I placed those compiled spark installs on each slave at /opt/spark My spark properties seem to be getting picked up on my side fine… [cid:683C1BA0-C9EC-448C-B1DB-E93A

Re: Spark on Mesos

for > Spark on Mesos. > > I installed a 3 master, 3 slave mesos cluster, which is all configured, > but I can’t for the life of me even get the spark shell to work properly. > > I get errors like this > org.apache.spark.SparkException: Job aborted due to stage failure: Task 5 >

Re: Spark on Mesos

e to get something even simple working for > Spark on Mesos. > > I installed a 3 master, 3 slave mesos cluster, which is all configured, > but I can’t for the life of me even get the spark shell to work properly. > > I get errors like this > org.apache.spark.SparkException: J

Spark on Mesos

So I can’t for the life of me to get something even simple working for Spark on Mesos. I installed a 3 master, 3 slave mesos cluster, which is all configured, but I can’t for the life of me even get the spark shell to work properly. I get errors like this org.apache.spark.SparkException: Job

Re: Spark on Mesos / Executor Memory

ally influenced by the number of concurrent tasks running? Given a >>> shared cluster, I have no idea what % of an individual slave my executor is >>> going to get, so I basically have to set the executor memory to a value >>> that's correct when the whole machine is in use... >>> >>> Has anyone else running Spark on Mesos come across this, or maybe >>> someone could correct my understanding of the config options? >>> >>> Thanks! >>> >>> Tom. >>> >> >> >

Re: deployment of spark on mesos and data locality in tachyon/hdfs

Response inline. On Tue, Mar 31, 2015 at 10:41 PM, Sean Bigdatafun wrote: > (resending...) > > I was thinking the same setup… But the more I think of this problem, and > the more interesting this could be. > > If we allocate 50% total memory to Tachyon statically, then the Mesos > benefits of dy

Re: deployment of spark on mesos and data locality in tachyon/hdfs

(resending...) I was thinking the same setup… But the more I think of this problem, and the more interesting this could be. If we allocate 50% total memory to Tachyon statically, then the Mesos benefits of dynamically scheduling resources go away altogether. Can Tachyon be resource managed by Me

Minimum slots assigment to Spark on Mesos

Hi All, I am running Spark & MR on Mesos. Is there a configuration setting for Spark to define the minimum required slots (similar to MapReduce's mapred.mesos.total.reduce.slots.minimum and mapred.mesos.total.map.slots. minimum)? The most related property I see is this: spark.scheduler. minRegiste

Re: deployment of spark on mesos and data locality in tachyon/hdfs

16:43, Haoyuan Li wrote: > > Tachyon should be co-located with Spark in this case. > > > > Best, > > > > Haoyuan > > > > On Tue, Mar 31, 2015 at 4:30 PM, Ankur Chauhan > > mailto:achau...@brightcove.com>> wrote: > > > > Hi, > >

Re: deployment of spark on mesos and data locality in tachyon/hdfs

ailto:achau...@brightcove.com>> wrote: > > Hi, > > I am fairly new to the spark ecosystem and I have been trying to > setup a spark on mesos deployment. I can't seem to figure out the > "best practices" around HDFS and Tachyon. The documentation about > Spa

Re: deployment of spark on mesos and data locality in tachyon/hdfs

Tachyon should be co-located with Spark in this case. Best, Haoyuan On Tue, Mar 31, 2015 at 4:30 PM, Ankur Chauhan wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Hi, > > I am fairly new to the spark ecosystem and I have been trying to setup > a spark on meso

deployment of spark on mesos and data locality in tachyon/hdfs

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, I am fairly new to the spark ecosystem and I have been trying to setup a spark on mesos deployment. I can't seem to figure out the "best practices" around HDFS and Tachyon. The documentation about Spark's data-locality section

Re: Spark on Mesos: Multiple Users with iPython Notebooks

there any sort of time frame I could possibly communicate to my team? Anything I can do? Thanks! On Fri, Feb 20, 2015 at 4:36 AM, Iulian Dragoș wrote: > > > On Thu, Feb 19, 2015 at 2:49 PM, John Omernik wrote: >> >> I am running Spark on Mesos and it works quite well.

Re: Spark on Mesos: Multiple Users with iPython Notebooks

On Thu, Feb 19, 2015 at 2:49 PM, John Omernik wrote: > I am running Spark on Mesos and it works quite well. I have three > users, all who setup iPython notebooks to instantiate a spark instance > to work with on the notebooks. I love it so far. > > Since I am "auto" in

Spark on Mesos: Multiple Users with iPython Notebooks

I am running Spark on Mesos and it works quite well. I have three users, all who setup iPython notebooks to instantiate a spark instance to work with on the notebooks. I love it so far. Since I am "auto" instantiating (I don't want a user to have to "think" about insta

Re: Data locality running Spark on Mesos

ingle powerful executor per node. Would be really useful once this feature you've mentioned: https://issues.apache.org/jira/browse/SPARK-5095 is implemented. Spark on Mesos fine-grained configuration: driver memory = 1G spark.executor.memory 6g (tried also with 1g, still one executor per node and

Re: Data locality running Spark on Mesos

em using some sample benchmarks provided by > the vanilla Spark distribution. > It is very possible that I have something very screwy in my workload or setup. > > The parameters I used for the Spark on Mesos are the following: > driver memory = 1G > total-executor-cores = 60

Re: Data locality running Spark on Mesos

using some sample benchmarks provided by the vanilla Spark distribution. It is very possible that I have something very screwy in my workload or setup. The parameters I used for the Spark on Mesos are the following: driver memory = 1G total-executor-cores = 60 spark.executor.memo

Re: Data locality running Spark on Mesos

ssue might be the reason for the slow down but I > can't figure out why, especially for coarse-grained mode as the executors > supposedly do not go away until job completion. > > Any ideas? > > Thanks, > Mike > > > > -- > View this message in context: > http:/

Data locality running Spark on Mesos

tances per node. However, when running the same workload on the same cluster but now with Spark on Mesos (course-grained mode), the execution time is somewhere around 15min. Actually, I tried with find-grained mode and giving each Mesos node 6 VCPUs (to hopefully get 6 executors like the stand

run spark on mesos localy

can see mesos master. I also started spark, and I can see the spark master on master:8080 with worker. I set enviroment variabels too: MESOS_NATIVE_LIBRARY=/usr/local/lib/libmesos.dylib SPARK_HOME=/Projects/Spark/spark I tried to run spark on mesos as a follows: valsConf = SparkConf().setMaster

Submit application to spark on mesos cluster

Hi, I have a little problem in submitting our application to a mesos cluster. Basically the mesos cluster is configured and I'm able to have spark-shell working correctly. Then I tried to launch our application jar (a uber, sbt assembly jar with all deps): bin/spark-submit --master mesos://10.19

RE: Spark on Mesos Issue - Do I need to install Spark on Mesos slaves

I have actually had the same problem. spark.executor.uri on HDFS did not work so I had to put it in a local folder -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-on-Mesos-Issue-Do-I-need-to-install-Spark-on-Mesos-slaves-tp16129p16165.html Sent from

RE: Spark on Mesos Issue - Do I need to install Spark on Mesos slaves

spark-defaults.conf spark.executor.uri hdfs://:9000/user//spark-1.1.0-bin-hadoop2.4.tgz From: Bijoy Deb [mailto:bijoy.comput...@gmail.com] Sent: den 10 oktober 2014 11:59 To: user@spark.apache.org Subject: Spark on Mesos Issue - Do I need to install Spark on Mesos slaves Hi, I

Spark on Mesos Issue - Do I need to install Spark on Mesos slaves

Hi, I am trying to submit a Spark job on Mesos using spark-submit from my Mesos-Master machine. My SPARK_HOME = /vol1/spark/spark-1.0.2-bin-hadoop2 I have uploaded the spark-1.0.2-bin-hadoop2.tgz to hdfs so that the mesos slaves can download it to invoke the Mesos Spark backend executor. But on

Re: Spark on Mesos: Pyspark python libraries

PYSPARK_PYTHON may work for you, it's used to specify which Python interpreter should be used in both driver and worker. For example, if anaconda was installed as /anaconda on all the machines, then you can specify PYSPARK_PYTHON=/anaconda/bin/python to use anaconda virtual environment in PySpark.

Spark on Mesos: Pyspark python libraries

Hi all, I am getting started with spark and mesos, I already have spark running on a mesos cluster and I am able to start the scala spark and pyspark shells, yay!. I still have questions on how to distribute 3rd party python libraries since i want to use stuff like nltk and mlib on pyspark that re

Spark on Mesos cause mesos-master OOM

Hi List, We're recently trying to running spark on Mesos, however, we encountered a fatal error that mesos-master process will continuousely consume memory and finally killed by OOM Killer, this situation only happening if has spark job (fine-grained mode) running. We finally root cause

Issues starting up Spark on mesos - akka.version

I'm new to Spark and not very experienced with scala issues. I'm facing this error message while trying to start up Spark on Mesos on a vagrant box. vagrant@mesos:~/installs/spark-1.0.0$ java -cp rickshaw-spark-0.0.1-SNAPSHOT.jar com.evocalize.rickshaw.spark.applications.GenerateSEO

Run Spark on Mesos? Add yourself to the #PoweredByMesos list

Hi All, It's great to see a growing number of companies Powered By Spark ! If you're running Spark on Apache Mesos , drop me a line or post to the u...@mesos.apache.org list and we'll also be happy to add

Spark On Mesos

...[error] Server access Error: Connection timed out url=https://oss.sonatype.org/content/repositories/snapshots/org/eclipse/jetty/jetty-http/7.6.8.v20121106/jetty-http-7.6.8.v20121106.pom... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-On-Mesos

Re: java.lang.ClassNotFoundException - spark on mesos

View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/java-lang-ClassNotFoundException-spark-on-mesos-tp3510p5245.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Error when run Spark on mesos

:13.007647 24156 gc.cpp:56] Scheduling '/tmp/mesos/slaves/201404021638-2315299008-5050-6539-1/frameworks/201404032011-2315299008-5050-13793-' for gc 6.9991207111days in the future Thanks and regards Gino Mathews K From: felix [mailto:cnwe...@gmail.com] Sent: Thursday, April 03,

Re: Error when run Spark on mesos

; > > > Thanks and regards > > Gino Mathews K > > > > *From:* panfei [mailto:[hidden > email]<http://user/SendEmail.jtp?type=node&node=3702&i=0>] > > *Sent:* Thursday, April 03, 2014 11:37 AM > *To:* [hidden email] <http://user/SendEmail.jtp?typ

Re: Error when run Spark on mesos

la:163) >>> at akka.actor.ActorCell.terminate(ActorCell.scala:338) at >>> akka.actor.ActorCell.invokeAll$1(ActorCell.scala:431) at >>> akka.actor.ActorCell.systemInvoke(ActorCell.scala:447) at >>> akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:262) at

Re: Error when run Spark on mesos

xecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at >> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >

Re: Error when run Spark on mesos

scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at >> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >> at >> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >> >> View this message in context: Error when run Spark on mesos >> Sent from the Apache Spark User List mailing list archive at Nabble.com. > > > > -- > 不学习，不知道

Re: Error when run Spark on mesos

va:1339) > at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) > at > scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > > -- > View this message in context: Error when run Spark on > mesos<http://apache-spark-user-list.1001560.n3

Error when run Spark on mesos

scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Error-when-run-Spark-on-mesos-tp3687.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: java.lang.ClassNotFoundException - spark on mesos

ion. I also tried modifying pom.xml only for mesos and that fails too. So I have no way of running the 1.0.0 git tree spark on mesos yet. Thanks. On 01-Apr-2014, at 3:28 am, deric wrote: Which repository do you use? The issue should be fixed in 0.9.1 and 1.0.0 https://spark-project.atlassian.

Re: java.lang.ClassNotFoundException - spark on mesos

mesos and that fails too. So I have no way of running the 1.0.0 git tree spark on mesos yet. Thanks. On 01-Apr-2014, at 3:28 am, deric wrote: > Which repository do you use? > > The issue should be fixed in 0.9.1 and 1.0.0 > > https://spark-project.atlassian.net/browse/SPAR

Re: java.lang.ClassNotFoundException - spark on mesos

ew this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/java-lang-ClassNotFoundException-spark-on-mesos-tp3510p3551.html > Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: java.lang.ClassNotFoundException - spark on mesos

f top level projects, it was moved to new repo: https://github.com/apache/spark The 0.9.1 version hasn't been released yet, so you should get it from the new git repo. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/java-lang-ClassNotFoundExceptio

Re: java.lang.ClassNotFoundException - spark on mesos

l Message - >> From: "Bharath Bhushan" >> To: user@spark.apache.org >> Sent: Monday, March 31, 2014 9:46:32 AM >> Subject: Re: java.lang.ClassNotFoundException - spark on mesos >> >> I tried 0.9.0 and the latest git tree of spark. For mesos, I tried

Re: java.lang.ClassNotFoundException - spark on mesos

, March 31, 2014 9:46:32 AM > Subject: Re: java.lang.ClassNotFoundException - spark on mesos > > I tried 0.9.0 and the latest git tree of spark. For mesos, I tried 0.17.0 and > the latest git tree. > > Thanks > > > On 31-Mar-2014, at 7:24 pm, Tim St Clair wrote: > >

Re: java.lang.ClassNotFoundException - spark on mesos

; Cheers, > Tim > > - Original Message - >> From: "Bharath Bhushan" >> To: user@spark.apache.org >> Sent: Monday, March 31, 2014 8:16:19 AM >> Subject: java.lang.ClassNotFoundException - spark on mesos >> >> I am facing different kinds of java

Re: java.lang.ClassNotFoundException - spark on mesos

ndException - spark on mesos > > I am facing different kinds of java.lang.ClassNotFoundException when trying > to run spark on mesos. One error has to do with > org.apache.spark.executor.MesosExecutorBackend. Another has to do with > org.apache.spark.serializer.JavaSerializer. I

java.lang.ClassNotFoundException - spark on mesos

I am facing different kinds of java.lang.ClassNotFoundException when trying to run spark on mesos. One error has to do with org.apache.spark.executor.MesosExecutorBackend. Another has to do with org.apache.spark.serializer.JavaSerializer. I see other people complaining about similar issues. I

Re: Run spark on mesos remotely

Dear all, After studying the source code and my environment, I guess the problem is that the hostPort is wrong. On my machine, the hostname will be exported into `blockManager.hostPort` such as wush-home:45678, but the slaves could not resolve the hostname to ip correctly. I am trying to solve the

Re: Run spark on mesos remotely

Dear Rustagi, Thanks for you response. As far as I know, the DAG scheduler should be a part of spark. Therefore, should I do something not mentioned in http://spark.incubator.apache.org/docs/0.8.1/running-on-mesos.html to launch the DAG scheduler? By the way, I also notice that the user of the s

Re: Run spark on mesos remotely

Yes but you have to maintain connection of that machine to the master cluster as the driver with DAG scheduler runs on that machine. Regards Mayur Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Thu, Mar 27, 2014 at 4:09

Run spark on mesos remotely

Dear all, We have a spark 0.8.1 cluster on mesos 0.15. It works if I submit the job from the master of mesos. That is to say, I spawn the spark shell or launch the scala application on the master of mesos. However, when I submit the job from another machine, the job will lost. The logs shows that

Problem with Spark on Mesos

001560.n3.nabble.com/Problem-with-Spark-on-Mesos-tp2283.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

<    1   2