Re: spark-sorted, or secondary sort and streaming reduce for spark

2015-03-06 Thread Koert Kuipers
i added it On Fri, Mar 6, 2015 at 2:40 PM, Burak Yavuz wrote: > Hi Koert, > > Would you like to register this on spark-packages.org? > > Burak > > On Fri, Mar 6, 2015 at 8:53 AM, Koert Kuipers wrote: > >> currently spark provides many excellent algorithms for operations per key >> as long as th

Re: spark-sorted, or secondary sort and streaming reduce for spark

2015-03-06 Thread Burak Yavuz
Hi Koert, Would you like to register this on spark-packages.org? Burak On Fri, Mar 6, 2015 at 8:53 AM, Koert Kuipers wrote: > currently spark provides many excellent algorithms for operations per key > as long as the data send to the reducers per key fits in memory. operations > like combineBy