Re: Fastest way to map/parallel read all values in a table?

2015-02-09 Thread Kevin Burton
/cql_record_processor Also, I guess you probably know that, but I would consider using Spark for doing this. Best regards, Marcelo. From: user@cassandra.apache.org Subject: Re:Fastest way to map/parallel read all values in a table? What’s the fastest way to map/parallel read all values

Re: Fastest way to map/parallel read all values in a table?

2015-02-09 Thread graham sanderson
? What’s the fastest way to map/parallel read all values in a table? Kind of like a mini map only job. I’m doing this to compute stats across our entire corpus. What I did to begin with was use token() and then spit it into the number of splits I needed. So I just took the total key range

Fastest way to map/parallel read all values in a table?

2015-02-08 Thread Kevin Burton
What’s the fastest way to map/parallel read all values in a table? Kind of like a mini map only job. I’m doing this to compute stats across our entire corpus. What I did to begin with was use token() and then spit it into the number of splits I needed. So I just took the total key range space