Re: Exclude a host from the repair process

[Stone Fang]

@Alain now we agree with on this point "the repair continuing for ranges
not involving the dead node"
 and we agree with that it will fail for ranges involve the down node.

actually i dont think this is a good idea of “those ranges including the
dead node could be repaired between the 2 other replicas that are up
(considering RF=3)”.
we dont know which is the latest record from two replicates,(the down node
may be the right record)so even if we repair,we just get the latest record
of these two replicates,but not the right one.


On Thu, Jul 21, 2016 at 5:51 PM, Alain RODRIGUEZ <arodr...@gmail.com> wrote:

> what I mean is repiar will ignore all the replica data that stored in down
>> node.and continue to repair  other data.
>> once the down node up,then repair can work on the replica data belong to
>> the down node.
>>
>
> That's what I understood the first time, but thanks for trying to clarify
> :-). I am saying that what I saw in the past was the repair continuing for
> ranges not involving the dead node as you said, but all the failed ranges
> will not be automatically resumed unless you use some external tool as
> OpsCenter repair feature or Spotify Reaper (I believe both handle this by
> putting to the queue all the ranges that fail to be re-run, I might be
> wrong).
>
> If a node is down in my cluster.
>>
>> Is it possible to exclude him from the repair process in order to
>> continue with the repair?
>> If not
>> Is the repair continue reparing the other replicas even if one is down?
>>
>
> It is exactly what this ticket
> https://issues.apache.org/jira/browse/CASSANDRA-10446 is about. Those
> ranges including the dead node could be repaired between the 2 other
> replicas that are up (considering RF=3). The work is to be done, you can
> follow that, vote for it or even develop it if it is something that is
> worth it for you Jean.
>
> C*heers
> ---
> Alain Rodriguez - al...@thelastpickle.com
> France
>
> The Last Pickle - Apache Cassandra Consulting
> http://www.thelastpickle.com
>
>
> 2016-07-21 10:28 GMT+02:00 Stone Fang <cnstonef...@gmail.com>:
>
>> Hi
>> @Alain Rodriguez.what I mean is repiar will ignore all the replica data
>> that stored in down node.and continue to repair  other data.
>> once the down node up,then repair can work on the replica data belong to
>> the down node.
>>
>> run repair always a daily work with auto script.we dont need to exclude
>> the down node as there are always down nodes in cluster.
>>
>> thanks
>> stone
>>
>> On Wed, Jul 20, 2016 at 7:20 PM, Amit Singh F <amit.f.si...@ericsson.com>
>> wrote:
>>
>>> Hi Jean,
>>>
>>>
>>>
>>> This option is available in C* version 2.1.x & above, where you can
>>> specify hosts in nodetool  repair command . For more detail please visit
>>> the link below :
>>>
>>>
>>>
>>>
>>> https://docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsRepair.html
>>>
>>>
>>>
>>> Regards
>>>
>>> Amit Singh
>>>
>>>
>>>
>>> *From:* Alain RODRIGUEZ [mailto:arodr...@gmail.com]
>>> *Sent:* Wednesday, July 20, 2016 4:42 PM
>>> *To:* user@cassandra.apache.org
>>> *Subject:* Re: Exclude a host from the repair process
>>>
>>>
>>>
>>> Hi Jean,
>>>
>>>
>>>
>>> All the nodes are not necessary involved in a repair depending on vnodes
>>> being enabled or not, on your topology, on the racks you are using etc.
>>>
>>>
>>>
>>> This being said, if a node was supposed to be part of a repair process,
>>> the repair of all the subranges including the down node will fail. That's
>>> what I have seen happening so far. @Stone Fang, not sure who is right on
>>> this (I might have missed some information about this topic), but there is
>>> a ticket about this topic:
>>> https://issues.apache.org/jira/browse/CASSANDRA-10446. You apparently
>>> can specify which nodes to repair, but a down node is not automatically
>>> ignored as far as I can tell.
>>>
>>>
>>>
>>> C*heers,
>>>
>>> ---
>>>
>>> Alain Rodriguez - al...@thelastpickle.com
>>>
>>> France
>>>
>>>
>>>
>>> The Last Pickle - Apache Cassandra Consulting
>>>
>>> http://www.thelastpickle.com
>>>
>>>
>>>
>>> 2016-07-14 9:16 GMT+02:00 Stone Fang <cnstonef...@gmail.com>:
>>>
>>> dont think it is necessary to remove the down node.
>>>
>>> the repair will continue comparing with other up node.ignore the down
>>> node.
>>>
>>>
>>>
>>> On Wed, Jul 13, 2016 at 9:44 PM, Jean Carlo <jean.jeancar...@gmail.com>
>>> wrote:
>>>
>>> If a node is down in my cluster.
>>>
>>> Is it possible to exclude him from the repair process in order to
>>> continue with the repair?
>>>
>>> If not
>>>
>>> Is the repair continue reparing the other replicas even if one is down?
>>>
>>> Best regards
>>>
>>>
>>>
>>> Jean Carlo
>>>
>>>
>>> "The best way to predict the future is to invent it" Alan Kay
>>>
>>>
>>>
>>>
>>>
>>
>>
>

Re: Exclude a host from the repair process

[Alain RODRIGUEZ]

>
> what I mean is repiar will ignore all the replica data that stored in down
> node.and continue to repair  other data.
> once the down node up,then repair can work on the replica data belong to
> the down node.
>

That's what I understood the first time, but thanks for trying to clarify
:-). I am saying that what I saw in the past was the repair continuing for
ranges not involving the dead node as you said, but all the failed ranges
will not be automatically resumed unless you use some external tool as
OpsCenter repair feature or Spotify Reaper (I believe both handle this by
putting to the queue all the ranges that fail to be re-run, I might be
wrong).

If a node is down in my cluster.
>
> Is it possible to exclude him from the repair process in order to continue
> with the repair?
> If not
> Is the repair continue reparing the other replicas even if one is down?
>

It is exactly what this ticket
https://issues.apache.org/jira/browse/CASSANDRA-10446 is about. Those
ranges including the dead node could be repaired between the 2 other
replicas that are up (considering RF=3). The work is to be done, you can
follow that, vote for it or even develop it if it is something that is
worth it for you Jean.

C*heers
---
Alain Rodriguez - al...@thelastpickle.com
France

The Last Pickle - Apache Cassandra Consulting
http://www.thelastpickle.com


2016-07-21 10:28 GMT+02:00 Stone Fang <cnstonef...@gmail.com>:

> Hi
> @Alain Rodriguez.what I mean is repiar will ignore all the replica data
> that stored in down node.and continue to repair  other data.
> once the down node up,then repair can work on the replica data belong to
> the down node.
>
> run repair always a daily work with auto script.we dont need to exclude
> the down node as there are always down nodes in cluster.
>
> thanks
> stone
>
> On Wed, Jul 20, 2016 at 7:20 PM, Amit Singh F <amit.f.si...@ericsson.com>
> wrote:
>
>> Hi Jean,
>>
>>
>>
>> This option is available in C* version 2.1.x & above, where you can
>> specify hosts in nodetool  repair command . For more detail please visit
>> the link below :
>>
>>
>>
>>
>> https://docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsRepair.html
>>
>>
>>
>> Regards
>>
>> Amit Singh
>>
>>
>>
>> *From:* Alain RODRIGUEZ [mailto:arodr...@gmail.com]
>> *Sent:* Wednesday, July 20, 2016 4:42 PM
>> *To:* user@cassandra.apache.org
>> *Subject:* Re: Exclude a host from the repair process
>>
>>
>>
>> Hi Jean,
>>
>>
>>
>> All the nodes are not necessary involved in a repair depending on vnodes
>> being enabled or not, on your topology, on the racks you are using etc.
>>
>>
>>
>> This being said, if a node was supposed to be part of a repair process,
>> the repair of all the subranges including the down node will fail. That's
>> what I have seen happening so far. @Stone Fang, not sure who is right on
>> this (I might have missed some information about this topic), but there is
>> a ticket about this topic:
>> https://issues.apache.org/jira/browse/CASSANDRA-10446. You apparently
>> can specify which nodes to repair, but a down node is not automatically
>> ignored as far as I can tell.
>>
>>
>>
>> C*heers,
>>
>> ---
>>
>> Alain Rodriguez - al...@thelastpickle.com
>>
>> France
>>
>>
>>
>> The Last Pickle - Apache Cassandra Consulting
>>
>> http://www.thelastpickle.com
>>
>>
>>
>> 2016-07-14 9:16 GMT+02:00 Stone Fang <cnstonef...@gmail.com>:
>>
>> dont think it is necessary to remove the down node.
>>
>> the repair will continue comparing with other up node.ignore the down
>> node.
>>
>>
>>
>> On Wed, Jul 13, 2016 at 9:44 PM, Jean Carlo <jean.jeancar...@gmail.com>
>> wrote:
>>
>> If a node is down in my cluster.
>>
>> Is it possible to exclude him from the repair process in order to
>> continue with the repair?
>>
>> If not
>>
>> Is the repair continue reparing the other replicas even if one is down?
>>
>> Best regards
>>
>>
>>
>> Jean Carlo
>>
>>
>> "The best way to predict the future is to invent it" Alan Kay
>>
>>
>>
>>
>>
>
>

Re: Exclude a host from the repair process

[Stone Fang]

Hi
@Alain Rodriguez.what I mean is repiar will ignore all the replica data
that stored in down node.and continue to repair  other data.
once the down node up,then repair can work on the replica data belong to
the down node.

run repair always a daily work with auto script.we dont need to exclude the
down node as there are always down nodes in cluster.

thanks
stone

On Wed, Jul 20, 2016 at 7:20 PM, Amit Singh F <amit.f.si...@ericsson.com>
wrote:

> Hi Jean,
>
>
>
> This option is available in C* version 2.1.x & above, where you can
> specify hosts in nodetool  repair command . For more detail please visit
> the link below :
>
>
>
> https://docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsRepair.html
>
>
>
> Regards
>
> Amit Singh
>
>
>
> *From:* Alain RODRIGUEZ [mailto:arodr...@gmail.com]
> *Sent:* Wednesday, July 20, 2016 4:42 PM
> *To:* user@cassandra.apache.org
> *Subject:* Re: Exclude a host from the repair process
>
>
>
> Hi Jean,
>
>
>
> All the nodes are not necessary involved in a repair depending on vnodes
> being enabled or not, on your topology, on the racks you are using etc.
>
>
>
> This being said, if a node was supposed to be part of a repair process,
> the repair of all the subranges including the down node will fail. That's
> what I have seen happening so far. @Stone Fang, not sure who is right on
> this (I might have missed some information about this topic), but there is
> a ticket about this topic:
> https://issues.apache.org/jira/browse/CASSANDRA-10446. You apparently can
> specify which nodes to repair, but a down node is not automatically ignored
> as far as I can tell.
>
>
>
> C*heers,
>
> ---
>
> Alain Rodriguez - al...@thelastpickle.com
>
> France
>
>
>
> The Last Pickle - Apache Cassandra Consulting
>
> http://www.thelastpickle.com
>
>
>
> 2016-07-14 9:16 GMT+02:00 Stone Fang <cnstonef...@gmail.com>:
>
> dont think it is necessary to remove the down node.
>
> the repair will continue comparing with other up node.ignore the down node.
>
>
>
> On Wed, Jul 13, 2016 at 9:44 PM, Jean Carlo <jean.jeancar...@gmail.com>
> wrote:
>
> If a node is down in my cluster.
>
> Is it possible to exclude him from the repair process in order to continue
> with the repair?
>
> If not
>
> Is the repair continue reparing the other replicas even if one is down?
>
> Best regards
>
>
>
> Jean Carlo
>
>
> "The best way to predict the future is to invent it" Alan Kay
>
>
>
>
>

RE: Exclude a host from the repair process

[Amit Singh F]

Hi Jean,

This option is available in C* version 2.1.x & above, where you can specify 
hosts in nodetool  repair command . For more detail please visit the link below 
:

https://docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsRepair.html

Regards
Amit Singh

From: Alain RODRIGUEZ [mailto:arodr...@gmail.com]
Sent: Wednesday, July 20, 2016 4:42 PM
To: user@cassandra.apache.org
Subject: Re: Exclude a host from the repair process

Hi Jean,

All the nodes are not necessary involved in a repair depending on vnodes being 
enabled or not, on your topology, on the racks you are using etc.

This being said, if a node was supposed to be part of a repair process, the 
repair of all the subranges including the down node will fail. That's what I 
have seen happening so far. @Stone Fang, not sure who is right on this (I might 
have missed some information about this topic), but there is a ticket about 
this topic: https://issues.apache.org/jira/browse/CASSANDRA-10446. You 
apparently can specify which nodes to repair, but a down node is not 
automatically ignored as far as I can tell.

C*heers,
---
Alain Rodriguez - al...@thelastpickle.com<mailto:al...@thelastpickle.com>
France

The Last Pickle - Apache Cassandra Consulting
http://www.thelastpickle.com

2016-07-14 9:16 GMT+02:00 Stone Fang 
<cnstonef...@gmail.com<mailto:cnstonef...@gmail.com>>:
dont think it is necessary to remove the down node.
the repair will continue comparing with other up node.ignore the down node.

On Wed, Jul 13, 2016 at 9:44 PM, Jean Carlo 
<jean.jeancar...@gmail.com<mailto:jean.jeancar...@gmail.com>> wrote:
If a node is down in my cluster.

Is it possible to exclude him from the repair process in order to continue with 
the repair?
If not
Is the repair continue reparing the other replicas even if one is down?
Best regards

Jean Carlo

"The best way to predict the future is to invent it" Alan Kay

Re: Exclude a host from the repair process

[Alain RODRIGUEZ]

Hi Jean,

All the nodes are not necessary involved in a repair depending on vnodes
being enabled or not, on your topology, on the racks you are using etc.

This being said, if a node was supposed to be part of a repair process, the
repair of all the subranges including the down node will fail. That's what
I have seen happening so far. @Stone Fang, not sure who is right on this (I
might have missed some information about this topic), but there is a ticket
about this topic: https://issues.apache.org/jira/browse/CASSANDRA-10446.
You apparently can specify which nodes to repair, but a down node is not
automatically ignored as far as I can tell.

C*heers,
---
Alain Rodriguez - al...@thelastpickle.com
France

The Last Pickle - Apache Cassandra Consulting
http://www.thelastpickle.com

2016-07-14 9:16 GMT+02:00 Stone Fang :

> dont think it is necessary to remove the down node.
> the repair will continue comparing with other up node.ignore the down node.
>
> On Wed, Jul 13, 2016 at 9:44 PM, Jean Carlo 
> wrote:
>
>> If a node is down in my cluster.
>>
>> Is it possible to exclude him from the repair process in order to
>> continue with the repair?
>> If not
>> Is the repair continue reparing the other replicas even if one is down?
>>
>> Best regards
>>
>> Jean Carlo
>>
>> "The best way to predict the future is to invent it" Alan Kay
>>
>
>

Re: Exclude a host from the repair process

[Stone Fang]

dont think it is necessary to remove the down node.
the repair will continue comparing with other up node.ignore the down node.

On Wed, Jul 13, 2016 at 9:44 PM, Jean Carlo 
wrote:

> If a node is down in my cluster.
>
> Is it possible to exclude him from the repair process in order to continue
> with the repair?
> If not
> Is the repair continue reparing the other replicas even if one is down?
>
> Best regards
>
> Jean Carlo
>
> "The best way to predict the future is to invent it" Alan Kay
>

Exclude a host from the repair process

[Jean Carlo]

If a node is down in my cluster.

Is it possible to exclude him from the repair process in order to continue
with the repair?
If not
Is the repair continue reparing the other replicas even if one is down?

Best regards

Jean Carlo

"The best way to predict the future is to invent it" Alan Kay