Re: Spark Job Submitting on Mesos Cluster

2015-09-13 Thread SLiZn Liu
Thx Tommy, did you mean add proxy user like this: spark-submit --proxy-user ... where represents the user who started Mesos? and is this parameter documented anywhere? ​ On Mon, Sep 14, 2015 at 1:34 PM tommy xiao wrote: > @SLiZn Liu yes, you need add proxy_user parameter and your cluster >

Re: Spark Job Submitting on Mesos Cluster

2015-09-13 Thread SLiZn Liu
No, we set up a specific user to start mesos, it isn't root. On Mon, Sep 14, 2015 at 1:05 PM haosdent wrote: > Do you start your mesos cluster with root? > > On Mon, Sep 14, 2015 at 12:10 PM, SLiZn Liu > wrote: > >> Hi Mesos Users, >> >> I’m trying to run Spark jobs on my Mesos cluster. However

Re: Spark Job Submitting on Mesos Cluster

2015-09-13 Thread tommy xiao
@SLiZn Liu yes, you need add proxy_user parameter and your cluster should have the proxy_user in the /etc/passwd in every node. 2015-09-14 13:05 GMT+08:00 haosdent : > Do you start your mesos cluster with root? > > On Mon, Sep 14, 2015 at 12:10 PM, SLiZn Liu > wrote: > >> Hi Mesos Users, >> >>

Re: Spark Job Submitting on Mesos Cluster

2015-09-13 Thread haosdent
Do you start your mesos cluster with root? On Mon, Sep 14, 2015 at 12:10 PM, SLiZn Liu wrote: > Hi Mesos Users, > > I’m trying to run Spark jobs on my Mesos cluster. However I discovered > that my Spark job must be submitted by the same user who started Mesos, > otherwise a ExecutorLostFailure w

Re: 0.24.0 eggs

2015-09-13 Thread Adam Bordelon
Egg publishing is a part of the formal release process. It is listed under "Update external tooling" at the end of the release guide. http://mesos.apache.org/documentation/latest/release-guide/ I think we're still working on finishing up this release. Even mesos.apache.org hasn't been updated yet.

Spark Job Submitting on Mesos Cluster

2015-09-13 Thread SLiZn Liu
Hi Mesos Users, I’m trying to run Spark jobs on my Mesos cluster. However I discovered that my Spark job must be submitted by the same user who started Mesos, otherwise a ExecutorLostFailure will rise, and the job won’t be executed. Is there anyway that every user share a same Mesos cluster in har