Yes Controller (192.168.1.200) and that 192.168.1.114 is one of the workers.
Worker system is busy, i will try with akka.LogLevel=DEBUG and see what it gives, thanks. On Friday, March 7, 2014 5:06:34 AM UTC-8, Björn Antonsson wrote: > > Hi, > > First, which version of Akka are you using? > > I assume this is the log from the Controller (192.168.1.200) and that > 192.168.1.114 is one of the workers. What is happening on Worker1 & > Worker2? Are the machines idle or busy? Are the worker actors blocking on a > resource or so long running that they starve the rest of the system? > > If you enable debug logging with akka.LogLevel=DEBUG, you might get some > useful information in the logs. > > B/ > > On 6 March 2014 at 22:47:56, HARSH PATEL ([email protected]<javascript:>) > wrote: > > *Error:* > > [INFO] [03/06/2014 13:01:46.131] [http-bio-8080-exec-1] [Remoting] Remoting > started; listening on addresses :[akka.tcp://[email protected]:2552] > [INFO] [03/06/2014 13:05:39.519] > [KafeBackend-akka.actor.default-dispatcher-24] > [akka://KafeBackend/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A2553-1] > Message [akka.remote.transport.AssociationHandle$Disassociated] from > Actor[akka://KafeBackend/deadLetters] to > Actor[akka://KafeBackend/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A2553-1#-1687561879] > was not delivered. [1] dead letters encountered. This logging can be turned > off or adjusted with configuration settings 'akka.log-dead-letters' and > 'akka.log-dead-letters-during-shutdown'. > [INFO] [03/06/2014 13:05:39.529] > [KafeBackend-akka.actor.default-dispatcher-13] > [akka://KafeBackend/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A2553-1] > Message [akka.remote.transport.ActorTransportAdapter$DisassociateUnderlying] > from Actor[akka://KafeBackend/deadLetters] to > Actor[akka://KafeBackend/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A2553-1#-1687561879] > was not delivered. [2] dead letters encountered. This logging can be turned > off or adjusted with configuration settings 'akka.log-dead-letters' and > 'akka.log-dead-letters-during-shutdown'. > [WARN] [03/06/2014 13:05:40.164] > [KafeBackend-akka.actor.default-dispatcher-20] > [akka://KafeBackend/system/remote-watcher] Detected unreachable: > [akka.tcp://[email protected]:2553] > [INFO] [03/06/2014 13:05:40.166] > [KafeBackend-akka.actor.default-dispatcher-13] [Remoting] Address > [akka.tcp://[email protected]:2553] is now quarantined, all messages > to this address will be delivered to dead letters. > [INFO] [03/06/2014 13:05:40.173] > [KafeBackend-akka.actor.default-dispatcher-23] > [akka://KafeBackend/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A2553-1/endpointWriter] > Message [akka.remote.EndpointWriter$StopReading] from > Actor[akka://KafeBackend/system/endpointManager#1099349744] to > Actor[akka://KafeBackend/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A2553-1/endpointWriter#-1331845317] > was not delivered. [3] dead letters encountered. This logging can be turned > off or adjusted with configuration settings 'akka.log-dead-letters' and > 'akka.log-dead-letters-during-shutdown'. > [INFO] [03/06/2014 13:05:40.537] > [KafeBackend-akka.actor.default-dispatcher-13] > [akka://KafeBackend/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A2553-1/endpointWriter] > Message [akka.remote.EndpointWriter$Handle] from > Actor[akka://KafeBackend/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A2553-1/endpointWriter#-1331845317] > to > Actor[akka://KafeBackend/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A2553-1/endpointWriter#-1331845317] > was not delivered. [4] dead letters encountered. This logging can be turned > off or adjusted with configuration settings 'akka.log-dead-letters' and > 'akka.log-dead-letters-during-shutdown'. > [INFO] [03/06/2014 13:06:39.046] > [KafeBackend-akka.actor.default-dispatcher-17] > [akka://KafeBackend/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A35023-4] > Message [akka.remote.transport.AssociationHandle$Disassociated] from > Actor[akka://KafeBackend/deadLetters] to > Actor[akka://KafeBackend/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2FKafeBackend%40192.168.1.114%3A35023-4#-608406314] > was not delivered. [5] dead letters encountered. This logging can be turned > off or adjusted with configuration settings 'akka.log-dead-letters' and > 'akka.log-dead-letters-during-shutdown'. > > > *Controller System config:* > > > akka { > log-dead-letters-during-shutdown = off > actor { > provider = "akka.remote.RemoteActorRefProvider" > remote { > enabled-transports = ["akka.remote.netty.tcp"] > transport-failure-detector { > acceptable-heartbeat-pause = 100 s > } > watch-failure-detector { > acceptable-heartbeat-pause = 100 s > } > netty.tcp { > hostname = "" > port = 2552 > } > } > serializers { > java = "akka.serialization.JavaSerializer" > } > serialization-bindings { > "com.healthline.kafe.backend.messages.IKafeMessage" = java > } > } > } > > > *Remote Worker config:* > > > akka { > log-dead-letters-during-shutdown = off > actor { > provider = "akka.remote.RemoteActorRefProvider" > } > remote { > enabled-transports = ["akka.remote.netty.tcp"] > netty.tcp { > hostname = "" > port = 2553 > } > } > } > > > I start up remote system using > > system = ActorSystem.create(name, conf); > > > Controller system deploys actors on remote worker system > > private final ActorRef router = > getContext().actorOf(Props.create(Worker.class).withRouter(new > RemoteRouterConfig(new RoundRobinRouter(getNumWorkers()), getNodes())), > "router"); > > getNodes has address of remote worker system. > > > Application starts and runs for sometime, after few task it goes into > quarantined, don't know how to stop that. Controller and Worker1 / Worker2 > each are separate machines. > > > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: > http://doc.akka.io/docs/akka/current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] <javascript:>. > To post to this group, send email to [email protected]<javascript:> > . > Visit this group at http://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/groups/opt_out. > > -- > Björn Antonsson > Typesafe <http://typesafe.com/> – Reactive Apps on the JVM > twitter: @bantonsson <http://twitter.com/#!/bantonsson> > > -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
