Re: spark-stream programme failed on yarn-client

2015-03-06 Thread fenghaixiong
Thanks ,you advise is usefull I just submit my job on my spark client which config with simple configure file so it failed when i run my job on service machine everything is okay On Fri, Mar 06, 2015 at 02:10:04PM +0530, Akhil Das wrote: Looks like an issue with your yarn setup, could you

Re: spark-stream programme failed on yarn-client

2015-03-06 Thread Akhil Das
Looks like an issue with your yarn setup, could you try doing a simple example with spark-shell? Start the spark shell as: $*MASTER=yarn-client bin/spark-shell* *spark-shell *sc.parallelize(1 to 1000).collect ​If that doesn't work, then make sure your yarn services are up and running and in

spark-stream programme failed on yarn-client

2015-03-05 Thread fenghaixiong
Hi all, I'm try to write a spark stream programme so i read the