At that scale of data, and the fact that it's a batch job, I would go with the bulk loading tool.
Cheers ----------------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 19/10/2011, at 3:32 AM, Mike Rapuano wrote: > We are not currently live but testing with Cassandra. I'm looking for > recommendations on the most efficient way to load text files over 25GBs in > size to Cassandra (version 0.8.6). Our application may require us to load > 2-3 text files between 25-40GBs each a few times a week to our 3 node > cluster. I was reading this article on DataStax: > http://www.datastax.com/dev/blog/bulk-loading > > Is it most efficient to create the sstables and then use sstableloader or > does anyone have other recommendations to "bulk load data"? We are new to > Cassandra and trying to work within what is generally acceptable practices. > > Thanks > Mike > > >
