Hi Igor
Thanks . The reason I am using cluster mode is this the stream app must will
run for ever. I am using client mode for my pyspark work
Andy
From: Igor Berman
Date: Friday, November 20, 2015 at 6:22 AM
To: Andrew Davidson
Cc: "user @spark"
Subject: Re: newbie: unable to
u've asked total cores to be 2 + 1 for driver(since you are running in
cluster mode, so it's running on one of the slaves)
change total cores to be 3*2
change submit mode to be client - you'll have full utilization
(btw it's not advisable to use all cores of slave...since there is OS
processes and
I am having a heck of a time figuring out how to utilize my cluster
effectively. I am using the stand alone cluster manager. I have a master
and 3 slaves. Each machine has 2 cores.
I am trying to run a streaming app in cluster mode and pyspark at the same
time.
t1) On my console I see
*
