Hi, Everyone:
I'm importing a CSV file into Cassandra, and it always get
error:Request did not complete within rpc_timeout , then I have to
continue my COPY command of cql again. And the CSV file is 2.2 G . It is
taking a long time.
How can I speed up csv file importing ? Is there
for performing such heavy operations instead try
using SSTableLoader to import.
Best Regards
Akshay
From:严超 yanchao...@gmail.com
To:user@cassandra.apache.org
Date:12/04/2014 02:11 PM
Subject:[Import csv to Cassandra] Taking too much time
Hi, Everyone:
I'm importing a CSV file into Cassandra using SStableLoader. And
I'm following the example here:
https://github.com/yukim/cassandra-bulkload-example/
When i try to run the sstableloader, it fails with OOM. I also
changed the sstableloader.sh script (that runs
even with all generated files (e.g.
.Filter etc) in the target directory.
Rory
On Wed, Dec 10, 2014, 12:58 AM 严超 yanchao...@gmail.com wrote:
Hi, Everyone:
I'm importing a CSV file into Cassandra using SStableLoader. And
I'm following the example here:
https://github.com
--*
2014-12-10 20:24 GMT+08:00 严超 yanchao...@gmail.com:
Thank you very much.
My version is 2.0.11. I'll have a try.
*Best Regards!*
*Chao Yan--**My twitter:Andy Yan @yanchao727
https://twitter.com/yanchao727*
*My Weibo:http://weibo.com/herewearenow
http://weibo.com
Hi, Everyone:
I'm importing a CSV file into Cassandra using SStableLoader. And I'm
following the example here:
https://github.com/yukim/cassandra-bulkload-example/
But, Even though the streaming of SSTables is very fast , I find that
generation of SStables is quite slow for very large files
strange here, you don't have a lot
of RAM, nor CPU and I'm assuming the underlying disk is slow here as well.
Without more parameters and details it's hard to define if there is an
issue.
On Dec 24, 2014 7:36 AM, 严超 yanchao...@gmail.com wrote:
Hi, Everyone:
I'm importing a CSV file
Check out this doc, I think it may help you:
http://www.datastax.com/documentation/cassandra/2.0/cassandra/operations/ops_backup_restore_c.html
*Best Regards!*
*Chao Yan--**My twitter:Andy Yan @yanchao727
https://twitter.com/yanchao727*
*My Weibo:http://weibo.com/herewearenow
Seems like Size Tier Compaction is based on table, which table did you set
the compaction strategy?
A minor compaction does not involve all the tables in a keyspace.
Ref:
http://datastax.com/documentation/cassandra/2.0/cassandra/operations/ops_configure_compaction_t.html
How about delete the previous inserted lines? Then, insert it again?
*Best Regards!*
*Chao Yan--**My twitter:Andy Yan @yanchao727
https://twitter.com/yanchao727*
*My Weibo:http://weibo.com/herewearenow
http://weibo.com/herewearenow--*
2015-02-10 9:52 GMT+08:00 Alex
10 matches
Mail list logo