Hi, Can anyone point me how spark works ? Why is it trying to connect from master port A to master port ABCD in cluster mode with 6 workers ?
14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError [akka.tcp://sparkWorker@...:7078] -> [akka.tcp://sparkExecutor@...:53757]: Error [Association failed with [akka.tcp://sparkExecutor@...:53757]] [ akka.remote.EndpointAssociationException: Association failed with [akka.tcp://sparkExecutor@...:53757] Caused by: akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: Connection refused: spark-master1.domain.org/10.0.6.228:53757 ] 14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError [akka.tcp://sparkWorker@...:7078] -> [akka.tcp://sparkExecutor@...:53757]: Error [Association failed with [akka.tcp://sparkExecutor@...:53757]] [ akka.remote.EndpointAssociationException: Association failed with [akka.tcp://sparkExecutor@...:53757] Caused by: akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: Connection refused: spark-master1.domain.org/10.0.6.228:53757 ] I've spent almost a week trying to find solution and the more I dag the more same problems I found. Best regards, Morbious -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-in-cluster-and-errors-tp16249.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
