Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-28 Thread aaron morton
dataset... just under 4 months of data is less then 2GB! I'm pretty thrilled. Be thrilled by all the compressions ! :) Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 28/08/2012, at 6:10 AM, Aaron Turner synfina...@gmail.com wrote: On

Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-27 Thread aaron morton
After thinking about how sstables are done on disk, it seems best (required??) to write out each row at once. Sort of. We only want one instance of the row per SSTable created. Any other tips to improve load time or reduce the load on the cluster or subsequent compaction activity? Less

Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-27 Thread Aaron Turner
On Mon, Aug 27, 2012 at 1:19 AM, aaron morton aa...@thelastpickle.com wrote: After thinking about how sstables are done on disk, it seems best (required??) to write out each row at once. Sort of. We only want one instance of the row per SSTable created. Ah, good clarification, although I

optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-24 Thread Aaron Turner
So I've read: http://www.datastax.com/dev/blog/bulk-loading Are there any tips for using sstableloader / SSTableSimpleUnsortedWriter to migrate time series data from a our old datastore (PostgreSQL) to Cassandra? After thinking about how sstables are done on disk, it seems best (required??) to