Hi Aaron, I have 4 nodes - 1 master and 3 workers. I am not setting up driver public dns name anywhere. I didn't see that step in the documentation -- may be I missed it. Can you please point me in the right direction?
Sent via the Samsung GALAXY S®4, an AT&T 4G LTE smartphone <div>-------- Original message --------</div><div>From: Aaron Davidson <ilike...@gmail.com> </div><div>Date:07/08/2014 12:00 PM (GMT-08:00) </div><div>To: user@spark.apache.org </div><div>Subject: Re: CoarseGrainedExecutorBackend: Driver Disassociated </div><div> </div> Hmm, looks like the Executor is trying to connect to the driver on localhost, from this line: 14/07/08 11:07:13 INFO CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://spark@localhost:39701/user/CoarseGrainedScheduler What is your setup? Standalone mode with 4 separate machines? Are you configuring the driver public dns name somewhere? On Tue, Jul 8, 2014 at 11:52 AM, Sameer Tilak <ssti...@live.com> wrote: > Dear All, > > When I look inside the following directory on my worker node: > $SPARK_HOME/work/app-20140708110707-0001/3 > > I see the following error message: > > log4j:WARN No appenders could be found for logger > (org.apache.hadoop.conf.Configuration). > log4j:WARN Please initialize the log4j system properly. > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for > more info. > 14/07/08 11:07:11 INFO SparkHadoopUtil: Using Spark's default log4j > profile: org/apache/spark/log4j-defaults.properties > 14/07/08 11:07:11 INFO SecurityManager: Changing view acls to: p529444 > 14/07/08 11:07:11 INFO SecurityManager: SecurityManager: authentication > disabled; ui acls disabled; users with view permissions: Set(p529444) > 14/07/08 11:07:12 INFO Slf4jLogger: Slf4jLogger started > 14/07/08 11:07:12 INFO Remoting: Starting remoting > 14/07/08 11:07:13 INFO Remoting: Remoting started; listening on addresses > :[akka.tcp://sparkexecu...@pzxnvm2022.dcld.pldc.kp.org:34679] > 14/07/08 11:07:13 INFO Remoting: Remoting now listens on addresses: > [akka.tcp://sparkexecu...@pzxnvm2022.x.y.name.org:34679] > 14/07/08 11:07:13 INFO CoarseGrainedExecutorBackend: Connecting to driver: > akka.tcp://spark@localhost:39701/user/CoarseGrainedScheduler > 14/07/08 11:07:13 INFO WorkerWatcher: Connecting to worker akka.tcp:// > sparkwor...@pzxnvm2022.x.y.name.org:37054/user/Worker > 14/07/08 11:07:13 ERROR CoarseGrainedExecutorBackend: Driver Disassociated > [akka.tcp://sparkexecu...@pzxnvm2022.dcld.pldc.kp.org:34679] -> [akka > > > I am not sure what the problem is but it is preventing me to get the 4 > node test cluster up and running. > >
