Hi Team,
I have a two nodes(A and B) in a Akka cluster. I am using Akka cluster
singleton
When initial cluster, A is a Oldest node and B is a Younger node.
I manually killed A node using control C command. After some time, I
started Node A but Node A is not rejoining the cluster. Node A starting in
its own cluster.
Now I have a two clusters A and B.
I am getting below exceptions.
How to resolve this issue? Please help me
*Exception 1:-*
[WARN] [06/26/2016 00:28:07.842]
[ClusterSystem-akka.actor.default-dispatcher-15]
[akka.tcp://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon]
Cluster Node [akka.tcp://ClusterSystem@127.0.0.1:2552] - Marking node(s) as
UNREACHABLE [Member(address = akka.tcp://ClusterSystem@127.0.0.1:2551,
status = Up)]
[INFO] [06/26/2016 00:28:17.851]
[ClusterSystem-akka.actor.default-dispatcher-24]
[akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node
[akka.tcp://ClusterSystem@127.0.0.1:2552] - Leader is auto-downing
unreachable node [akka.tcp://ClusterSystem@127.0.0.1:2551]
[INFO] [06/26/2016 00:28:17.851]
[ClusterSystem-akka.actor.default-dispatcher-19]
[akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node
[akka.tcp://ClusterSystem@127.0.0.1:2552] - Marking unreachable node
[akka.tcp://ClusterSystem@127.0.0.1:2551] as [Down]
[INFO] [06/26/2016 00:28:18.853]
[ClusterSystem-akka.actor.default-dispatcher-15]
[akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node
[akka.tcp://ClusterSystem@127.0.0.1:2552] - Leader is removing unreachable
node [akka.tcp://ClusterSystem@127.0.0.1:2551]
[INFO] [06/26/2016 00:28:18.853]
[ClusterSystem-akka.actor.default-dispatcher-24]
[akka.tcp://ClusterSystem@127.0.0.1:2552/user/clusterSingleton] Member
removed [akka.tcp://ClusterSystem@127.0.0.1:2551]
[WARN] [06/26/2016 00:28:19.007]
[ClusterSystem-akka.remote.default-remote-dispatcher-6]
[akka.tcp://ClusterSystem@127.0.0.1:2552/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FClusterSystem%40127.0.0.1%3A2551-1]
Association with remote system [akka.tcp://ClusterSystem@127.0.0.1:2551]
has failed, address is now gated for [5000] ms. Reason: [Disassociated]
*Exception 2:-*
[WARN] [06/26/2016 03:48:34.827]
[ClusterSystem-akka.remote.default-remote-dispatcher-19]
[akka.tcp://ClusterSystem@127.0.0.1:2552/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FClusterSystem%40127.0.0.1%3A2551-1]
Association with remote system [akka.tcp://ClusterSystem@127.0.0.1:2551]
has failed, address is now gated for [5000] ms. Reason: [Disassociated]
[ERROR] [06/26/2016 03:48:34.832]
[ClusterSystem-akka.remote.default-remote-dispatcher-20]
[akka.remote.Remoting] Association to
[akka.tcp://ClusterSystem@127.0.0.1:2551] with UID [1216631716]
irrecoverably failed. Quarantining address.
java.lang.IllegalStateException: Error encountered while processing system
message acknowledgement buffer: [0 {}] ack: ACK[1, {}]
at
akka.remote.ReliableDeliverySupervisor$$anonfun$receive$1.applyOrElse(Endpoint.scala:299)
at akka.actor.Actor$class.aroundReceive(Actor.scala:484)
at
akka.remote.ReliableDeliverySupervisor.aroundReceive(Endpoint.scala:198)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526)
at akka.actor.ActorCell.invoke(ActorCell.scala:495)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
at akka.dispatch.Mailbox.run(Mailbox.scala:224)
at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.lang.IllegalArgumentException: Highest SEQ so far was 0 but
cumulative ACK is 1
at akka.remote.AckedSendBuffer.acknowledge(AckedDelivery.scala:103)
at
akka.remote.ReliableDeliverySupervisor$$anonfun$receive$1.applyOrElse(Endpoint.scala:295)
... 11 more
[WARN] [06/26/2016 03:48:34.833]
[ClusterSystem-akka.actor.default-dispatcher-15]
[akka.tcp://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon]
Cluster Node [akka.tcp://ClusterSystem@127.0.0.1:2552] - Marking node as
TERMINATED [akka.tcp://ClusterSystem@127.0.0.1:2551], due to quarantine.
Node roles []
[INFO] [06/26/2016 03:48:34.835]
[ClusterSystem-akka.actor.default-dispatcher-15]
[akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node
[akka.tcp://ClusterSystem@127.0.0.1:2552] - Marking unreachable node
[akka.tcp://ClusterSystem@127.0.0.1:2551] as [Down]
[INFO] [06/26/2016 03:48:35.182]
[ClusterSystem-akka.remote.default-remote-dispatcher-20]
[akka.remote.Remoting] Quarantined address
[akka.tcp://ClusterSystem@127.0.0.1:2551] is still unreachable or has not
been restarted. Keeping it quarantined.
[INFO] [06/26/2016 03:48:35.403]
[ClusterSystem-akka.actor.default-dispatcher-2]
[akka.cluster.Cluster(akka://ClusterSystem)] Cluster Node
[akka.tcp://ClusterSystem@127.0.0.1:2552] - Leader is removing unreachable
node [akka.tcp://ClusterSystem@127.0.0.1:2551]
(Member is Removed: {} after
{},akka.tcp://ClusterSystem@127.0.0.1:2551,Down)
[INFO] [06/26/2016 03:48:35.408]
[ClusterSystem-akka.actor.default-dispatcher-16]
[akka.tcp://ClusterSystem@127.0.0.1:2552/user/clusterSingleton] Member
removed [akka.tcp://ClusterSystem@127.0.0.1:2551]
Regards,
Rajesh
--
>>>>>>>>>> Read the docs: http://akka.io/docs/
>>>>>>>>>> Check the FAQ:
>>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups "Akka
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.
