Its clearly saying *Connection refused: 172.22.193.138:7077 <http://172.22.193.138:7077> *just make sure your master URL is listed as spark://172.22.193.138:7077 in the webUI(that running on port 8080), also be sure that no firewall/network is blocking the connection (simple *telnet 172.22.193.138 7077 *will work if there's no network issue)
Thanks Best Regards On Wed, Jan 14, 2015 at 11:39 AM, Abhideep Chakravarty < abhideep.chakrava...@mindtree.com> wrote: > Let me rephrase that it is a Play-Scala app which is trying to connect > with the Spark. > > > > *From:* Abhideep Chakravarty > *Sent:* Wednesday, January 14, 2015 11:34 AM > *To:* 'user@spark.apache.org' > *Subject:* Spark 1.2.0 not getting connected > > > > Hi, > > > > We are using Scala app to connect with the Spark and when we start the > application we get following error: > > > > *19:52:47.185 [sparkDriver-akka.actor.default-dispatcher-2] INFO > o.a.s.d.client.AppClient$ClientActor - Connecting to master > spark://172.22.193.138:7077...* > > *19:52:47.198 [sparkDriver-akka.actor.default-dispatcher-5] WARN Remoting > - Tried to associate with unreachable remote address > [akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>]. Address is now gated for 5000 > ms, all messages to this address will be delivered to dead letters. Reason: > Connection refused: /172.22.193.138:7077 <http://172.22.193.138:7077>* > > *19:52:47.200 [sparkDriver-akka.actor.default-dispatcher-3] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > Disassociated [akka.tcp://sparkDriver@172.22.193.138:54148 > <http://sparkDriver@172.22.193.138:54148>] -> > [akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>] from > Actor[akka://sparkDriver/deadLetters]* > > *19:52:47.201 [sparkDriver-akka.actor.default-dispatcher-3] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.0178 ms) > Disassociated [akka.tcp://sparkDriver@172.22.193.138:54148 > <http://sparkDriver@172.22.193.138:54148>] -> > [akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>] from > Actor[akka://sparkDriver/deadLetters]* > > *19:52:47.202 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.d.client.AppClient$ClientActor - [actor] received message > AssociationError [akka.tcp://sparkDriver@172.22.193.138:54148 > <http://sparkDriver@172.22.193.138:54148>] -> > [akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>]: Error [Invalid address: > akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>] [* > > *akka.remote.InvalidAssociation: Invalid address: > akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>* > > *Caused by: akka.remote.transport.Transport$InvalidAssociationException: > Connection refused: /172.22.193.138:7077 <http://172.22.193.138:7077>* > > *] from Actor[akka://sparkDriver/deadLetters]* > > *19:52:47.202 [sparkDriver-akka.actor.default-dispatcher-2] WARN > o.a.s.d.client.AppClient$ClientActor - Could not connect to > akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>: akka.remote.InvalidAssociation: > Invalid address: akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>* > > *19:52:47.202 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.d.client.AppClient$ClientActor - [actor] handled message (0.5126 ms) > AssociationError [akka.tcp://sparkDriver@172.22.193.138:54148 > <http://sparkDriver@172.22.193.138:54148>] -> > [akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>]: Error [Invalid address: > akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>] [* > > *akka.remote.InvalidAssociation: Invalid address: > akka.tcp://sparkMaster@172.22.193.138:7077 > <http://sparkMaster@172.22.193.138:7077>* > > *Caused by: akka.remote.transport.Transport$InvalidAssociationException: > Connection refused: /172.22.193.138:7077 <http://172.22.193.138:7077>* > > *] from Actor[akka://sparkDriver/deadLetters]* > > *19:52:48.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:48.136 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.3807 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:49.145 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:49.145 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.3382 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:50.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:50.136 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2388 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:51.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:51.136 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.273601 > ms) ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:52.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:52.136 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2757 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:53.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:53.136 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2631 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:54.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:54.136 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.3165 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:55.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:55.136 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2841 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:56.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:56.136 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2209 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:57.135 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:57.136 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2898 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:58.135 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:58.136 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.4709 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:59.145 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:52:59.146 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.3125 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:00.145 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:00.145 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2347 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:01.144 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:01.145 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.220302 > ms) ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:02.145 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:02.146 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.278301 > ms) ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:03.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:03.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.308 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:04.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:04.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.218 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:05.135 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:05.135 [sparkDriver-akka.actor.default-dispatcher-15] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2197 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:06.025 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.BlockManagerMasterActor - [actor] received message ExpireDeadHosts > from Actor[akka://sparkDriver/user/BlockManagerMaster#83889750]* > > *19:53:06.026 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.BlockManagerMasterActor - [actor] handled message (0.0909 ms) > ExpireDeadHosts from > Actor[akka://sparkDriver/user/BlockManagerMaster#83889750]* > > *19:53:06.145 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:06.146 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2135 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:07.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] received message > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:07.135 [sparkDriver-akka.actor.default-dispatcher-2] DEBUG > o.a.s.s.c.SparkDeploySchedulerBackend - [actor] handled message (0.2215 ms) > ReviveOffers from > Actor[akka://sparkDriver/user/CoarseGrainedScheduler#-1468085206]* > > *19:53:07.176 [sparkDriver-akka.actor.default-dispatcher-2] ERROR > o.a.s.s.c.SparkDeploySchedulerBackend - Application has been killed. > Reason: All masters are unresponsive! Giving up.* > > *19:53:07.179 [main] WARN o.a.s.s.c.SparkDeploySchedulerBackend - > Application ID is not initialized yet.* > > *19:53:07.181 [sparkDriver-akka.actor.default-dispatcher-2] ERROR > o.a.s.scheduler.TaskSchedulerImpl - Exiting due to error from cluster > scheduler: All masters are unresponsive! Giving up.* > > *19:53:07.186 [delete Spark temp dirs] DEBUG org.apache.spark.util.Utils - > Shutdown hook called* > > *19:53:07.192 [delete Spark local dirs] DEBUG > o.a.spark.storage.DiskBlockManager - Shutdown hook called* > > > > > > Can anyone suggest something ?? > > > > Regards, > > Abhideep > > ------------------------------ > > http://www.mindtree.com/email/disclaimer.html >
