On Thu, Sep 10, 2015 at 3:35 AM, canan chen wrote:
> Finally got the answer. Actually it works fine. The allocation behavior
> on mesos is a little different from yarn/standalone. Seems the executor in
> mesos is lazily allocated (only when job is executed) while executor in
> yarn/standalone is
Finally got the answer. Actually it works fine. The allocation behavior on
mesos is a little different from yarn/standalone. Seems the executor in
mesos is lazily allocated (only when job is executed) while executor in
yarn/standalone is allocated when spark-shell is started.
On Tue, Sep 8, 201
Yes, I follow the guide in this doc, and run it as mesos client mode
On Tue, Sep 8, 2015 at 6:31 PM, Akhil Das
wrote:
> In which mode are you submitting your application? (coarse-grained or
> fine-grained(default)). Have you gone through this documentation already?
> http://spark.apache.org/docs
In which mode are you submitting your application? (coarse-grained or
fine-grained(default)). Have you gone through this documentation already?
http://spark.apache.org/docs/latest/running-on-mesos.html#using-a-mesos-master-url
Thanks
Best Regards
On Tue, Sep 8, 2015 at 12:54 PM, canan chen wrote
Hi all,
I try to run spark on mesos, but it looks like I can not allocate resources
from mesos. I am not expert of mesos, but from the mesos log, it seems
spark always decline the offer from mesos. Not sure what's wrong, maybe
need some configuration change. Here's the mesos master log
I0908 15:0