Re: Nested views: iterative map reduce implementation

2013-03-15 Thread Noah Slater
Hey Nick, This looks pretty great. Is it something you need assistance with? Anything I can do to help? Thanks, On 22 January 2013 15:18, nicholas a. evans n...@ekenosen.net wrote: I've started hacking on an implementation of iterative map reduce that I'm calling nested views. It's not

Re: Nested views: iterative map reduce implementation

2013-03-15 Thread Paul Davis
Definitely been meaning to provide a review for this. I'll try and get to it in a few hours. On Fri, Mar 15, 2013 at 2:36 PM, Noah Slater nsla...@apache.org wrote: Hey Nick, This looks pretty great. Is it something you need assistance with? Anything I can do to help? Thanks, On 22

Re: Nested views: iterative map reduce implementation

2013-03-15 Thread nicholas a. evans
Yes, there is *totally* stuff I need assistance with. :) This was my first attempt at learning Erlang, and I worked myself into a couple of dead ends and blindly coded myself into a few corners. It's been a few weeks since I looked at this, so it would take a little while for me to get back up

Re: Nested views: iterative map reduce implementation

2013-03-15 Thread Paul Davis
So the biggest thing here is that this won't work in a cluster. The issue being that each step in the view chain needs to run across the cluster so putting into every view updater is going to break things there. That said BenoƮt has a feature in rcouch that I we're going to be working on getting

Re: Nested views: iterative map reduce implementation

2013-03-15 Thread Paul Davis
Forgot to post a link to Benoit's big commit for that thing: https://github.com/refuge/couch_core/commit/14ad584c993e7a25c000d8db905fd0d0a88a24b4 On Fri, Mar 15, 2013 at 4:59 PM, Paul Davis paul.joseph.da...@gmail.com wrote: So the biggest thing here is that this won't work in a cluster. The

Re: Nested views: iterative map reduce implementation

2013-01-27 Thread Jan Lehnardt
Hi Nicholas, This looks very interesting. My apologies for not looking into this in more detail (it's CouchDB Conf week). I'll definitely have a closer look soon. Cheers Jan -- On 22.01.2013, at 16:18, nicholas a. evans n...@ekenosen.net wrote: I've started hacking on an implementation of

Nested views: iterative map reduce implementation

2013-01-22 Thread nicholas a. evans
I've started hacking on an implementation of iterative map reduce that I'm calling nested views. It's not nearly finished, but well overdue for feedback from people who know what they're doing with CouchDB and Erlang. :) My bosses are open to a short term contract

Re: Nested views: iterative map reduce implementation

2013-01-22 Thread Dirkjan Ochtman
On Tue, Jan 22, 2013 at 4:18 PM, nicholas a. evans n...@ekenosen.net wrote: I've started hacking on an implementation of iterative map reduce that I'm calling nested views. It's not nearly finished, but well overdue for feedback from people who know what they're doing with CouchDB and Erlang.

Re: Nested views: iterative map reduce implementation

2013-01-22 Thread nicholas a. evans
On Tue, Jan 22, 2013 at 10:18 AM, nicholas a. evans n...@ekenosen.net wrote: My (incomplete) code is at http://github.com/nevans/couchdb (in master). I moved this to the nested_views branch, to simplify diffs, etc. https://github.com/nevans/couchdb/compare/master...nested_views

Re: Nested views: iterative map reduce implementation

2013-01-22 Thread nicholas a. evans
On Tue, Jan 22, 2013 at 10:22 AM, Dirkjan Ochtman dirk...@ochtman.nl wrote: I think this same feature was previously called chained map/reduce (or views) around these parts. Yeah, they are both iterative incremental map/reduce. I thought it made sense to distinguish between the tightly coupled