And FlumeJava would be even more useful. As it stands, map-reduce based functions cannot composed across multiple function invocations. For a library to ever be useful, we need something like a java based flow rewriter.
On Thu, Sep 1, 2011 at 5:34 PM, Grant Ingersoll <[email protected]> wrote: > On Sep 1, 2011, at 2:47 PM, Sean Owen wrote: > > > That's completely right. The use case is more for restarting a failed job > > rather than configuring the pipeline. You "really" want to do something > > different like piece together your own job. > > yeah, this is the downside to our big monolithic drivers. Oozie or others > might be useful here.
