copy from one table to another

2018-04-08 Thread onmstester onmstester
Is there any way to copy some part of a table to another table in cassandra? A large amount of data should be copied so i don't want to fetch data to client and stream it back to cassandra using cql. Sent using Zoho Mail

Re: copy from one table to another

2018-04-08 Thread Nitan Kainth
If it for testing and you don’t need any specific data, just copy a set of sstables with all files of that sequence and move to target tables directory and rename it. Restart target node or run nodetool refresh Sent from my iPhone > On Apr 8, 2018, at 4:15 AM, onmstester onmstester

Re: copy from one table to another

2018-04-08 Thread Jean Carlo
You can use the same procedure to restore a table from snapshot from datastax webpage https://docs.datastax.com/en/cassandra/2.1/cassandra/operations/ops_backup_snapshot_restore_t.html Just two modifications. after step 5, modify the name of the sstables to add the name of the table you want to

Re: copy from one table to another

2018-04-08 Thread Dmitry Saprykin
You can copy hardlinks to ALL SSTables from old to new table and then delete part of data you do not need in a new one. On Sun, Apr 8, 2018 at 10:20 AM, Nitan Kainth wrote: > If it for testing and you don’t need any specific data, just copy a set of > sstables with all

Re: copy from one table to another

2018-04-08 Thread Dmitry Saprykin
IMHO The best step by step description of what you need to do is here https://issues.apache.org/jira/browse/CASSANDRA-1585?focusedCommentId=13488959=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-13488959 The only difference is that you need to copy data from one

Re: copy from one table to another

2018-04-08 Thread onmstester onmstester
Thank you all I need something like this: insert into table test2 select * from test1 where partition_key='SOME_KEYS'; The problem with copying sstable is that original table contains some billions of records and i only want some hundred millions of records from the table, so after

Re: copy from one table to another

2018-04-08 Thread Christophe Schmitz
If you need this kind of logic, you might want to consider using Spark. It's often used for data migration. You could load your list of partition_key in a Spark RDD, then use joinWithCassandraTable, and write the result back to your destination table. Just before the join, you could use