Re: Strategy tools for taking snapshots to load in another cluster instance

[Robert Coli]

On Wed, Nov 18, 2015 at 2:23 AM, Anishek Agarwal  wrote:

> We have 5 node prod cluster and 3 node test cluster. Is there a way i can
> take snapshot of a table in prod and load it test cluster. The cassandra
> versions are same.
>

http://www.pythian.com/blog/bulk-loading-options-for-cassandra/

=Rob

Re: Strategy tools for taking snapshots to load in another cluster instance

[Romain Hardouin]

My previous answer (sstableloader) allows you moving from larger to smaller 
cluster

Sent from Yahoo Mail on Android 
 
  On Tue, Nov 24, 2015 at 11:30, Anishek Agarwal wrote:   
Peer, 
that talks about having a similar sized cluster, I was wondering if there is a 
way for moving from larger to smaller cluster. I will try a few things as soon 
as i get time and update here.
On Thu, Nov 19, 2015 at 5:48 PM, Peer, Oded  wrote:


Have you read the DataStax documentation?

http://docs.datastax.com/en/cassandra/2.0/cassandra/operations/ops_snapshot_restore_new_cluster.html

 

 

From: Romain Hardouin [mailto:romainh...@yahoo.fr]
Sent: Wednesday, November 18, 2015 3:59 PM
To: user@cassandra.apache.org
Subject: Re: Strategy tools for taking snapshots to load in another cluster 
instance

 

| 
You can take a snapshot via nodetool then load sstables on your test cluster 
with sstableloader: 
docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsBulkloader_t.html





Sent from Yahoo Mail on Android

| 
From:"Anishek Agarwal" 
Date:Wed, Nov 18, 2015 at 11:24
Subject:Strategy tools for taking snapshots to load in another cluster instance

Hello

 

We have 5 node prod cluster and 3 node test cluster. Is there a way i can take 
snapshot of a table in prod and load it test cluster. The cassandra versions 
are same. 

 

Even if there is a tool that can help with this it will be great.

 

If not, how do people handle scenarios where data in prod is required in 
staging/test clusters for testing to make sure things are correct ? Does the 
cluster size have to be same to allow copying of relevant snapshot data etc? 

 

 

thanks

anishek
 |

 |


 


  

Re: Strategy tools for taking snapshots to load in another cluster instance

[Anishek Agarwal]

Peer,

that talks about having a similar sized cluster, I was wondering if there
is a way for moving from larger to smaller cluster. I will try a few things
as soon as i get time and update here.

On Thu, Nov 19, 2015 at 5:48 PM, Peer, Oded  wrote:

> Have you read the DataStax documentation?
>
>
> http://docs.datastax.com/en/cassandra/2.0/cassandra/operations/ops_snapshot_restore_new_cluster.html
>
>
>
>
>
> *From:* Romain Hardouin [mailto:romainh...@yahoo.fr]
> *Sent:* Wednesday, November 18, 2015 3:59 PM
> *To:* user@cassandra.apache.org
> *Subject:* Re: Strategy tools for taking snapshots to load in another
> cluster instance
>
>
>
> You can take a snapshot via nodetool then load sstables on your test
> cluster with sstableloader:
> docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsBulkloader_t.html
>
>
>
> Sent from Yahoo Mail on Android
> 
> --
>
> *From*:"Anishek Agarwal" 
> *Date*:Wed, Nov 18, 2015 at 11:24
> *Subject*:Strategy tools for taking snapshots to load in another cluster
> instance
>
> Hello
>
>
>
> We have 5 node prod cluster and 3 node test cluster. Is there a way i can
> take snapshot of a table in prod and load it test cluster. The cassandra
> versions are same.
>
>
>
> Even if there is a tool that can help with this it will be great.
>
>
>
> If not, how do people handle scenarios where data in prod is required in
> staging/test clusters for testing to make sure things are correct ? Does
> the cluster size have to be same to allow copying of relevant snapshot data
> etc?
>
>
>
>
>
> thanks
>
> anishek
>
>
>

RE: Strategy tools for taking snapshots to load in another cluster instance

[Peer, Oded]

Have you read the DataStax documentation?
http://docs.datastax.com/en/cassandra/2.0/cassandra/operations/ops_snapshot_restore_new_cluster.html


From: Romain Hardouin [mailto:romainh...@yahoo.fr]
Sent: Wednesday, November 18, 2015 3:59 PM
To: user@cassandra.apache.org
Subject: Re: Strategy tools for taking snapshots to load in another cluster 
instance

You can take a snapshot via nodetool then load sstables on your test cluster 
with sstableloader:
docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsBulkloader_t.html



Sent from Yahoo Mail on 
Android


From:"Anishek Agarwal" >
Date:Wed, Nov 18, 2015 at 11:24
Subject:Strategy tools for taking snapshots to load in another cluster instance
Hello

We have 5 node prod cluster and 3 node test cluster. Is there a way i can take 
snapshot of a table in prod and load it test cluster. The cassandra versions 
are same.

Even if there is a tool that can help with this it will be great.

If not, how do people handle scenarios where data in prod is required in 
staging/test clusters for testing to make sure things are correct ? Does the 
cluster size have to be same to allow copying of relevant snapshot data etc?


thanks
anishek

Re: Strategy tools for taking snapshots to load in another cluster instance

[Dominik Keil]

Hi Anishek,

we are currently also thinking about how to do this in the midterm,
though we don't have a test setup yet. My idea was do add one additional
node to the source cluster but put it in a different DC as far as
Cassandra is concerned. Using the network topology replication strategy
you'd assign this DC an RF of 1 for each KS. Obviously you probably want
to read and write in LOCAL_QUORUM them to not hamper performance and you
need more disk space on that machine. But then, I think, you can just
take a snapshot there and use sstableloader to load that into your
destination cluster. Since I haven't tried this yet, I cannot tell you
hoe feasible this is but it would be nice to get some input here if the
idea is at least sound :-)

Cheers

Am 18.11.2015 um 11:23 schrieb Anishek Agarwal:
> Hello
>
> We have 5 node prod cluster and 3 node test cluster. Is there a way i
> can take snapshot of a table in prod and load it test cluster. The
> cassandra versions are same. 
>
> Even if there is a tool that can help with this it will be great.
>
> If not, how do people handle scenarios where data in prod is required
> in staging/test clusters for testing to make sure things are correct ?
> Does the cluster size have to be same to allow copying of relevant
> snapshot data etc? 
>  
>
> thanks
> anishek

-- 
*Dominik Keil*
Movilizer GmbH
Julius-Hatry-Strasse 1
68163 Mannheim
Germany
movilizer.com 



movilizer.com 
*Reinvent Your Mobile Enterprise*


Movilizer Days 2015 - Save the date!



Be the first to know:
Twitter  | LinkedIn
 | Facebook

_
Company's registered office: Mannheim
HRB: 700323 / Country Court: Mannheim
Managing Directors: Alberto Zamora, Jörg Bernauer, Oliver Lesche
Please inform us immediately if this e-mail and/or any attachment was
transmitted incompletely or was not intelligible.
_
This e-mail and any attachment is for authorized use by the intended
recipient(s) only. It may contain proprietary material, confidential
information and/or be subject to legal privilege. It should not be
copied, disclosed to, retained or used by any other party. If you are
not an intended recipient then please promptly delete this e-mail and
any attachment and all copies and inform the sender.

Strategy tools for taking snapshots to load in another cluster instance

[Anishek Agarwal]

Hello

We have 5 node prod cluster and 3 node test cluster. Is there a way i can
take snapshot of a table in prod and load it test cluster. The cassandra
versions are same.

Even if there is a tool that can help with this it will be great.

If not, how do people handle scenarios where data in prod is required in
staging/test clusters for testing to make sure things are correct ? Does
the cluster size have to be same to allow copying of relevant snapshot data
etc?


thanks
anishek

Re: Strategy tools for taking snapshots to load in another cluster instance

[Romain Hardouin]

You can take a snapshot via nodetool then load sstables on your test cluster 
with sstableloader: 
docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsBulkloader_t.html


Sent from Yahoo Mail on Android

From:"Anishek Agarwal" 
Date:Wed, Nov 18, 2015 at 11:24
Subject:Strategy tools for taking snapshots to load in another cluster instance

Hello


We have 5 node prod cluster and 3 node test cluster. Is there a way i can take 
snapshot of a table in prod and load it test cluster. The cassandra versions 
are same. 


Even if there is a tool that can help with this it will be great.


If not, how do people handle scenarios where data in prod is required in 
staging/test clusters for testing to make sure things are correct ? Does the 
cluster size have to be same to allow copying of relevant snapshot data etc? 

 


thanks

anishek