Re: Dead node seen as UP by replacement node

2014-03-14 Thread Paulo Ricardo Motta Gomes
Hmm, we considered that option but if the old node is assassinated, his range will be assigned to a neighbor that doesn't have the data, what will cause empty reads. What we did to solve the problem was to do a safe removal via "nodetool removenode ", wait some hours for neighbors to stream that no

Re: Dead node seen as UP by replacement node

2014-03-14 Thread Rahul Menon
Since the older node is not available i would ask you to assassinate the old node and then get the node new node to bootstrap. On Thu, Mar 13, 2014 at 10:56 PM, Paulo Ricardo Motta Gomes < paulo.mo...@chaordicsystems.com> wrote: > Yes, exactly. > > > On Thu, Mar 13, 2014 at 1:27 PM, Rahul Menon

Re: Dead node seen as UP by replacement node

2014-03-13 Thread Paulo Ricardo Motta Gomes
Yes, exactly. On Thu, Mar 13, 2014 at 1:27 PM, Rahul Menon wrote: > And the token value as suggested is tokenvalueoddeadnode-1 ? > > > On Thu, Mar 13, 2014 at 9:29 PM, Paulo Ricardo Motta Gomes < > paulo.mo...@chaordicsystems.com> wrote: > >> Nope, they have different IPs. I'm using the procedu

Re: Dead node seen as UP by replacement node

2014-03-13 Thread Rahul Menon
And the token value as suggested is tokenvalueoddeadnode-1 ? On Thu, Mar 13, 2014 at 9:29 PM, Paulo Ricardo Motta Gomes < paulo.mo...@chaordicsystems.com> wrote: > Nope, they have different IPs. I'm using the procedure described here to > replace a dead node: > http://www.datastax.com/docs/1.1/c

Re: Dead node seen as UP by replacement node

2014-03-13 Thread Paulo Ricardo Motta Gomes
Nope, they have different IPs. I'm using the procedure described here to replace a dead node: http://www.datastax.com/docs/1.1/cluster_management#replacing-a-dead-node Dead node token: X (IP: Y) Replacement node token: X-1 (IP: Z) So, as soon as the replacement node (Z) is started, it sees the de

Re: Dead node seen as UP by replacement node

2014-03-13 Thread Rahul Menon
Are you replacing the node with the same token and the same IP? On Thu, Mar 13, 2014 at 4:36 AM, Paulo Ricardo Motta Gomes < paulo.mo...@chaordicsystems.com> wrote: > Some further info: > > I'm not using Vnodes, so I'm using the 1.1 replace node trick of setting > the initial_token in the cassan

Re: Dead node seen as UP by replacement node

2014-03-12 Thread Paulo Ricardo Motta Gomes
Some further info: I'm not using Vnodes, so I'm using the 1.1 replace node trick of setting the initial_token in the cassandra.yaml file to the value of the dead node's token -1, and autobootstrap=true. However, according to the Apache wiki ( https://wiki.apache.org/cassandra/Operations#For_versio

Dead node seen as UP by replacement node

2014-03-12 Thread Paulo Ricardo Motta Gomes
Hello, I'm trying to replace a dead node using the procedure in [1], but the replacement node initially sees the dead node as UP, and after a few minutes the node is marked as DOWN again, failing the streaming/bootstrap procedure of the replacement node. This dead node is always seen as DOWN by th