in 19 there is a chaining facility, I haven't looked at it yet, but it
may provide an alternative to the rather standard pattern of looping.
You may also what to check what mahout is doing as it is a common
problem in that space.
Delip Rao wrote:
Thanks Chris! I ended up doing something similar too.
On Mon, Dec 8, 2008 at 2:29 AM, Chris Dyer <[email protected]> wrote:
Hey Delip-
mapreduce doesn't really have any particular support for iterative
algorithms. You just have to put a loop in the control program and
set the output path from the previous iteration to be the input path
in the next iteration. This at least lets you control whether you
decide to keep around results of intermediate iterations or erase
them...
-Chris
On Mon, Dec 8, 2008 at 1:25 AM, Delip Rao <[email protected]> wrote:
Hi,
I need to run my map-reduce routines for several iterations so that
the output of an iteration becomes the input to the next iteration. Is
there a standard pattern to do this instead of calling
JobClient.runJob() in a loop?
Thanks,
Delip
