Re: how to take consistant snapshot?

2012-12-07 Thread Tyler Hobbs
Snapshots trigger a flush first, so data that's currently in the commit log will be covered by the snapshot. On Thu, Dec 6, 2012 at 11:52 PM, Andrey Ilinykh ailin...@gmail.com wrote: On Thu, Dec 6, 2012 at 7:34 PM, aaron morton aa...@thelastpickle.comwrote: For background

Re: how to take consistant snapshot?

2012-12-07 Thread Andrey Ilinykh
That's right. But when I have incremental backup on each CF gets flushed independently. I have hot CF which gets flushed every several minutes and regular CF which gets flushed every hour or so. They have references to each other and data in sstables is definitely inconsistent. On Fri, Dec 7,

Re: how to take consistant snapshot?

2012-12-07 Thread Tyler Hobbs
Right. I don't personally think incremental backup is useful beyond restoring individual nodes unless none of your data happens to reference any other rows. On Fri, Dec 7, 2012 at 11:37 AM, Andrey Ilinykh ailin...@gmail.com wrote: That's right. But when I have incremental backup on each CF

Re: how to take consistant snapshot?

2012-12-07 Thread Andrey Ilinykh
Agreed. On Fri, Dec 7, 2012 at 12:38 PM, Tyler Hobbs ty...@datastax.com wrote: Right. I don't personally think incremental backup is useful beyond restoring individual nodes unless none of your data happens to reference any other rows. On Fri, Dec 7, 2012 at 11:37 AM, Andrey Ilinykh

Re: how to take consistant snapshot?

2012-12-06 Thread aaron morton
For background http://wiki.apache.org/cassandra/Operations?highlight=%28snapshot%29#Consistent_backups If you it for a single node then yes there is a chance of inconsistency across CF's. If you have mulitple nodes the snashots you take on the later nodes will help. If you use CL QUOURM for

Re: how to take consistant snapshot?

2012-12-06 Thread Andrey Ilinykh
On Thu, Dec 6, 2012 at 7:34 PM, aaron morton aa...@thelastpickle.comwrote: For background http://wiki.apache.org/cassandra/Operations?highlight=%28snapshot%29#Consistent_backupshttp://wiki.apache.org/cassandra/Operations?highlight=(snapshot)#Consistent_backups If you it for a single node

how to take consistant snapshot?

2012-12-05 Thread Andrey Ilinykh
Hello, everybody! I have production cluster with incremental backup on and I want to clone it (create test one). I don't understand one thing- each column family gets flushed (and copied to backup storage) independently. Which means the total snapshot is inconsistent. If I restore from such