Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-20 Thread Branton Davis
On Mon, Oct 19, 2015 at 5:42 PM, Robert Coli wrote: > On Mon, Oct 19, 2015 at 9:20 AM, Branton Davis > wrote: > >> Is that also true if you're standing up multiple nodes from backups that >> already have data? Could you not stand up more than

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-20 Thread Robert Coli
On Tue, Oct 20, 2015 at 9:13 AM, Branton Davis wrote: > >> Just to clarify, I was thinking about a scenario/disaster where we lost > the entire cluster and had to rebuild from backups. I assumed we would > start each node with the backed up data and commit log

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-20 Thread Branton Davis
On Tue, Oct 20, 2015 at 3:31 PM, Robert Coli wrote: > On Tue, Oct 20, 2015 at 9:13 AM, Branton Davis > wrote: > >> >>> Just to clarify, I was thinking about a scenario/disaster where we lost >> the entire cluster and had to rebuild from

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-19 Thread Eric Stevens
.com> on behalf of Kevin Burton > Reply-To: "user@cassandra.apache.org" > Date: Sunday, October 18, 2015 at 8:10 PM > To: "user@cassandra.apache.org" > Subject: Re: Would we have data corruption if we bootstrapped 10 nodes at > once? > > ouch.. OK.. I thin

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-19 Thread Jeff Jirsa
quot; Date: Monday, October 19, 2015 at 3:40 PM To: "user@cassandra.apache.org" Subject: Re: Would we have data corruption if we bootstrapped 10 nodes at once? On Sun, Oct 18, 2015 at 8:10 PM, Kevin Burton <bur...@spinn3r.com> wrote: ouch.. OK.. I think I really shot myself in the f

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-19 Thread Robert Coli
On Sun, Oct 18, 2015 at 8:10 PM, Kevin Burton wrote: > ouch.. OK.. I think I really shot myself in the foot here then. This > might be bad. > Yep. https://issues.apache.org/jira/browse/CASSANDRA-7069 - "Prevent operator mistakes due to simultaneous bootstrap" But this

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-19 Thread Robert Coli
On Mon, Oct 19, 2015 at 9:20 AM, Branton Davis wrote: > Is that also true if you're standing up multiple nodes from backups that > already have data? Could you not stand up more than one at a time since > they already have the data? > An operator probably almost

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-19 Thread Branton Davis
nd `nodetool refresh` it into the new system. >> >> >> >> From: <burtonator2...@gmail.com> on behalf of Kevin Burton >> Reply-To: "user@cassandra.apache.org" >> Date: Sunday, October 18, 2015 at 8:10 PM >> To: "user@cassandra.apache.org

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-18 Thread Kevin Burton
records. > > > > From: <burtonator2...@gmail.com> on behalf of Kevin Burton > Reply-To: "user@cassandra.apache.org" > Date: Sunday, October 18, 2015 at 3:44 PM > To: "user@cassandra.apache.org" > Subject: Re: Would we have data corruption if we bootstrapp

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-18 Thread Raj Chudasama
> host and `nodetool refresh` it into the new system. > > > > From: <burtonator2...@gmail.com> on behalf of Kevin Burton > Reply-To: "user@cassandra.apache.org" > Date: Sunday, October 18, 2015 at 8:10 PM > To: "user@cassandra.apache.org" >

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-18 Thread Jeff Jirsa
data, leading to missing records. From: <burtonator2...@gmail.com> on behalf of Kevin Burton Reply-To: "user@cassandra.apache.org" Date: Sunday, October 18, 2015 at 3:44 PM To: "user@cassandra.apache.org" Subject: Re: Would we have data corruption if we bootstrapped 10

Re: Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-18 Thread Jeff Jirsa
e.org" Date: Sunday, October 18, 2015 at 3:44 PM To: "user@cassandra.apache.org" Subject: Re: Would we have data corruption if we bootstrapped 10 nodes at once? An shit.. I think we're seeing corruption.. missing records :-/ On Sat, Oct 17, 2015 at 10:45 AM, Kevin Burton <bur..

Would we have data corruption if we bootstrapped 10 nodes at once?

2015-10-17 Thread Kevin Burton
We just migrated from a 30 node cluster to a 45 node cluster. (so 15 new nodes) By default we have auto_boostrap = false so we just push our config to the cluster, the cassandra daemons restart, and they're not cluster members and are the only nodes in the cluster. Anyway. While I was about