Re: Efficiently filtering results directly in CS

2016-04-09 Thread vincent gromakowski
spark over c* can pushdown lots of things (basic filter or where clause to more advanced semi join) 2016-04-09 3:54 GMT+02:00 kurt Greaves : > If you're using C* 3.0 you can probably achieve this with UDFs. >

Re: Efficiently filtering results directly in CS

2016-04-08 Thread kurt Greaves
If you're using C* 3.0 you can probably achieve this with UDFs. http://www.planetcassandra.org/blog/user-defined-functions-in-cassandra-3-0/ On 9 April 2016 at 00:22, Kevin Burton wrote: > Ha.. Yes... C*... I guess I need something like coprocessors in > bigtable. > > On

Re: Efficiently filtering results directly in CS

2016-04-08 Thread Kevin Burton
Ha.. Yes... C*... I guess I need something like coprocessors in bigtable. On Fri, Apr 8, 2016 at 1:49 AM, vincent gromakowski < vincent.gromakow...@gmail.com> wrote: > c* I suppose > > 2016-04-07 19:30 GMT+02:00 Jonathan Haddad : > >> What is CS? >> >> On Thu, Apr 7, 2016

Re: Efficiently filtering results directly in CS

2016-04-08 Thread vincent gromakowski
c* I suppose 2016-04-07 19:30 GMT+02:00 Jonathan Haddad : > What is CS? > > On Thu, Apr 7, 2016 at 10:03 AM Kevin Burton wrote: > >> I have a paging model whereby we stream data from CS by fetching 'pages' >> thereby reading (sequentially) entire

Re: Efficiently filtering results directly in CS

2016-04-07 Thread Jonathan Haddad
What is CS? On Thu, Apr 7, 2016 at 10:03 AM Kevin Burton wrote: > I have a paging model whereby we stream data from CS by fetching 'pages' > thereby reading (sequentially) entire datasets. > > We're using the bucket approach where we write data for 5 minutes, then we > can

Efficiently filtering results directly in CS

2016-04-07 Thread Kevin Burton
I have a paging model whereby we stream data from CS by fetching 'pages' thereby reading (sequentially) entire datasets. We're using the bucket approach where we write data for 5 minutes, then we can just fetch the bucket for that range. Our app now has TONS of data and we have a piece of