I have akka-cluster in production. 
One of the nodes crushed (or stopped, I do not know exact what happened). 
I restarted the node, but it did not join to the cluster. It did not 
received cluster-member-up event. 
And when I tried to access to this node through JMX, it just returned false.

There is actual cluster-status result:
{
  "self-address": "akka.tcp://HubCache@hubcache1:2552",
  "members": [
    {
      "address": "akka.tcp://HubCache@hubcache1:2552",
      "status": "Up",
      "roles": [
        "HUB"
      ]
    },
    {
      "address": "akka.tcp://HubCache@hubcache2:2552",
      "status": "Up",
      "roles": [
        "HUB"
      ]
    },
    {
      "address": "akka.tcp://HubCache@hubcache3:2552",
      "status": "Up",
      "roles": [
        "HUB"
      ]
    },
    {
      "address": "akka.tcp://HubCache@webbackend1:2552",
      "status": "Leaving",
      "roles": [
        "WEB"
      ]
    },
    {
      "address": "akka.tcp://HubCache@webbackend2:2552",
      "status": "Up",
      "roles": [
        "WEB"
      ]
    },
    {
      "address": "akka.tcp://HubCache@webbackend3:2552",
      "status": "Up",
      "roles": [
        "WEB"
      ]
    }
  ],
  "unreachable": [
    {
      "node": "akka.tcp://HubCache@hubcache3:2552",
      "observed-by": [
        "akka.tcp://HubCache@webbackend3:2552"
      ]
    },
{
      "node": "akka.tcp://HubCache@webbackend1:2552",
      "observed-by": [
        "akka.tcp://HubCache@hubcache2:2552",
        "akka.tcp://HubCache@hubcache3:2552",
        "akka.tcp://HubCache@webbackend2:2552",
        "akka.tcp://HubCache@webbackend3:2552"
      ]
    },
{
      "node": "akka.tcp://HubCache@webbackend3:2552",
      "observed-by": [
        "akka.tcp://HubCache@hubcache3:2552"
      ]
    }
  ]
}

Then I tried to remove node:
# /opt/akka/bin/akka-cluster localhost 9999 down 
akka.tcp://HubCache@webbackend1:2552
Marking akka.tcp://HubCache@webbackend1:2552 as DOWN


Leave - the same:
# /opt/akka/bin/akka-cluster localhost 9999 leave 
akka.tcp://HubCache@webbackend1:2552
Scheduling akka.tcp://HubCache@webbackend1:2552 to LEAVE cluster

No logs related with such commands in the leader. No actions, state does 
not change at all. 
How can I repair cluster without stopping all nodes?

-- 
>>>>>>>>>>      Read the docs: http://akka.io/docs/
>>>>>>>>>>      Check the FAQ: 
>>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>>>>>>>>>      Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Reply via email to