Hi Team, I have a two nodes(A and B) in a Akka cluster. I am using Akka cluster singleton
When initial cluster, A is a Oldest node and B is a Younger node. I manually killed A node using control C command. After some time, I started Node A but Node A is not rejoining the cluster. Node A starting in its own cluster. Now I have a two clusters A and B. I am getting below exceptions. How to resolve this issue? Please help me *Exception 1:-* [WARN] [06/26/2016 00:28:07.842] [ClusterSystem-akka.actor.default-dispatcher-15] [akka.tcp://[email protected]:2552/system/cluster/core/daemon] Cluster Node [akka.tcp://[email protected]:2552] - Marking node(s) as UNREACHABLE [Member(address = akka.tcp://[email protected]:2551, status = Up)] [INFO] [06/26/2016 00:28:17.851] [ClusterSystem-akka.actor.default-dispatcher-24] [akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node [akka.tcp://[email protected]:2552] - Leader is auto-downing unreachable node [akka.tcp://[email protected]:2551] [INFO] [06/26/2016 00:28:17.851] [ClusterSystem-akka.actor.default-dispatcher-19] [akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node [akka.tcp://[email protected]:2552] - Marking unreachable node [akka.tcp://[email protected]:2551] as [Down] [INFO] [06/26/2016 00:28:18.853] [ClusterSystem-akka.actor.default-dispatcher-15] [akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node [akka.tcp://[email protected]:2552] - Leader is removing unreachable node [akka.tcp://[email protected]:2551] [INFO] [06/26/2016 00:28:18.853] [ClusterSystem-akka.actor.default-dispatcher-24] [akka.tcp://[email protected]:2552/user/clusterSingleton] Member removed [akka.tcp://[email protected]:2551] [WARN] [06/26/2016 00:28:19.007] [ClusterSystem-akka.remote.default-remote-dispatcher-6] [akka.tcp://[email protected]:2552/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FClusterSystem%40127.0.0.1%3A2551-1] Association with remote system [akka.tcp://[email protected]:2551] has failed, address is now gated for [5000] ms. Reason: [Disassociated] *Exception 2:-* [WARN] [06/26/2016 03:48:34.827] [ClusterSystem-akka.remote.default-remote-dispatcher-19] [akka.tcp://[email protected]:2552/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FClusterSystem%40127.0.0.1%3A2551-1] Association with remote system [akka.tcp://[email protected]:2551] has failed, address is now gated for [5000] ms. Reason: [Disassociated] [ERROR] [06/26/2016 03:48:34.832] [ClusterSystem-akka.remote.default-remote-dispatcher-20] [akka.remote.Remoting] Association to [akka.tcp://[email protected]:2551] with UID [1216631716] irrecoverably failed. Quarantining address. java.lang.IllegalStateException: Error encountered while processing system message acknowledgement buffer: [0 {}] ack: ACK[1, {}] at akka.remote.ReliableDeliverySupervisor$$anonfun$receive$1.applyOrElse(Endpoint.scala:299) at akka.actor.Actor$class.aroundReceive(Actor.scala:484) at akka.remote.ReliableDeliverySupervisor.aroundReceive(Endpoint.scala:198) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526) at akka.actor.ActorCell.invoke(ActorCell.scala:495) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257) at akka.dispatch.Mailbox.run(Mailbox.scala:224) at akka.dispatch.Mailbox.exec(Mailbox.scala:234) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.IllegalArgumentException: Highest SEQ so far was 0 but cumulative ACK is 1 at akka.remote.AckedSendBuffer.acknowledge(AckedDelivery.scala:103) at akka.remote.ReliableDeliverySupervisor$$anonfun$receive$1.applyOrElse(Endpoint.scala:295) ... 11 more [WARN] [06/26/2016 03:48:34.833] [ClusterSystem-akka.actor.default-dispatcher-15] [akka.tcp://[email protected]:2552/system/cluster/core/daemon] Cluster Node [akka.tcp://[email protected]:2552] - Marking node as TERMINATED [akka.tcp://[email protected]:2551], due to quarantine. Node roles [] [INFO] [06/26/2016 03:48:34.835] [ClusterSystem-akka.actor.default-dispatcher-15] [akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node [akka.tcp://[email protected]:2552] - Marking unreachable node [akka.tcp://[email protected]:2551] as [Down] [INFO] [06/26/2016 03:48:35.182] [ClusterSystem-akka.remote.default-remote-dispatcher-20] [akka.remote.Remoting] Quarantined address [akka.tcp://[email protected]:2551] is still unreachable or has not been restarted. Keeping it quarantined. [INFO] [06/26/2016 03:48:35.403] [ClusterSystem-akka.actor.default-dispatcher-2] [akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node [akka.tcp://[email protected]:2552] - Leader is removing unreachable node [akka.tcp://[email protected]:2551] (Member is Removed: {} after {},akka.tcp://[email protected]:2551,Down) [INFO] [06/26/2016 03:48:35.408] [ClusterSystem-akka.actor.default-dispatcher-16] [akka.tcp://[email protected]:2552/user/clusterSingleton] Member removed [akka.tcp://[email protected]:2551] Regards, Rajesh -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
