Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-28 Thread aaron morton
> dataset... just under 4 months of data is less then 2GB! I'm pretty > thrilled. Be thrilled by all the compressions ! :) Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 28/08/2012, at 6:10 AM, Aaron Turner wrote: > On Mon, Aug 27, 2012

Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-27 Thread Aaron Turner
On Mon, Aug 27, 2012 at 1:19 AM, aaron morton wrote: > After thinking about how > sstables are done on disk, it seems best (required??) to write out > each row at once. > > Sort of. We only want one instance of the row per SSTable created. Ah, good clarification, although I think for my purposes

Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-27 Thread aaron morton
> After thinking about how > sstables are done on disk, it seems best (required??) to write out > each row at once. Sort of. We only want one instance of the row per SSTable created. > Any other tips to improve load time or reduce the load on the cluster > or subsequent compaction activity?

optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-24 Thread Aaron Turner
So I've read: http://www.datastax.com/dev/blog/bulk-loading Are there any tips for using sstableloader / SSTableSimpleUnsortedWriter to migrate time series data from a our old datastore (PostgreSQL) to Cassandra? After thinking about how sstables are done on disk, it seems best (required??) to wr