Re: Cassandra Snapshots and directories

2017-05-14 Thread Anthony Grasso
Hi Daniel, Yes, you are right it does require some additional work to rsync just the snapshots. What about doing something like this to make rsync syntax for the backup easier? # in the Cassandra data directory, iterate through the keyspaces for ks in $(find . -type d -iname backup) do # itera

Re: Cassandra Snapshots and directories

2017-05-12 Thread Daniel Hölbling-Inzko
Hi Varun, yes you are right - that's the structure that gets created. But if I want to backup ALL columnfamilies at once this requires a quite complex rsync as Vladimir mentioned. I can't just copy over the /data/keyspace directory as that contains all the data AND all the snapshots. I really have

Re: Cassandra Snapshots and directories

2017-05-11 Thread Varun Gupta
I did not get your question completely, with "snapshot files are mixed with files and backup files". When you call nodetool snapshot, it will create a directory with snapshot name if specified or current timestamp at /data///backup/. This directory will have all sstables, metadata files and schema

Cassandra Snapshots and directories

2017-05-11 Thread Daniel Hölbling-Inzko
Hi, I am going through this guide to do backup/restore of cassandra data to a new cluster: http://docs.datastax.com/en/cassandra/2.1/cassandra/operations/ops_backup_snapshot_restore_t.html#task_ds_cmf_11r_gk When creating a snapshot I get the snapshot files mixed in with the normal data files and