Re: [Spark on mesos] Spark framework not re-registered and lost after mesos master restarted

2017-03-31 Thread Yu Wei
Got that. Thanks, Jared, (韦煜) Software developer Interested in open source software, big data, Linux From: Timothy Chen <tnac...@gmail.com> Sent: Friday, March 31, 2017 11:33:42 AM To: Yu Wei Cc: dev; us...@spark.apache.org Subject: Re: [Spark on mesos]

Re: [Spark on mesos] Spark framework not re-registered and lost after mesos master restarted

2017-03-30 Thread Yu Wei
something? Any advice? Thanks, Jared, (韦煜) Software developer Interested in open source software, big data, Linux From: Timothy Chen <tnac...@gmail.com> Sent: Friday, March 31, 2017 5:13 AM To: Yu Wei Cc: us...@spark.apache.org; dev Subject: Re: [Spark on

[Spark on mesos] Spark framework not re-registered and lost after mesos master restarted

2017-03-30 Thread Yu Wei
Hi guys, I encountered a problem about spark on mesos. I setup mesos cluster and launched spark framework on mesos successfully. Then mesos master was killed and started again. However, spark framework couldn't be re-registered again as mesos agent does. I also couldn't find any error logs.

Spark on mesos, it seemed spark dispatcher didn't abort when authorization failed

2016-12-26 Thread Yu Wei
Hi Guys, When running some cases about spark on mesos, it seemed that spark dispatcher didn't abort when authorization failed. It seemed that spark dispatcher detected the error but did not handle it properly. The detailed log is as below, 16/12/26 16:02:08 INFO Utils: Successfully started

driver in queued state and not started

2016-12-05 Thread Yu Wei
Hi Guys, I tried to run spark on mesos cluster. However, when I tried to submit jobs via spark-submit. The driver is in "Queued state" and not started. Which should I check? Thanks, Jared, (??) Software developer Interested in open source software, big data, Linux

subscribe

2016-11-14 Thread Yu Wei
Thanks, Jared, (??) Software developer Interested in open source software, big data, Linux

Failed to run spark jobs on mesos due to "hadoop" not found.

2016-11-10 Thread Yu Wei
Hi Guys, I failed to launch spark jobs on mesos. Actually I submitted the job to cluster successfully. But the job failed to run. I1110 18:25:11.095507 301 fetcher.cpp:498] Fetcher Info: