This feature seems to be principly driven by a few folks @ Yahoo. Arun Murthy seems to be quite involved.
Hama is also getting into the MRv2 game: https://issues.apache.org/jira/browse/HAMA-431 Quick presentation on the framework by Sharad Agarwal (Yahoo): https://issues.apache.org/jira/secure/attachment/12485267/hadoop_contributors_meet_07_01_2011.pdf Seems to be a considerably more native/clean approach than managing a bunch of C++ to Java wrappers, imho. I'd really like to see a lot of frameworks on Hadoop; could have a language like Pig that then compiled down not only to different ML techniques, but also execute them on the proper framework in MRv2 as well. JP On Thu, Sep 1, 2011 at 1:12 PM, Danny Bickson <[email protected]> wrote: > This is definitely a very interesting option to integrate both projects. I > will forward this to my > collaborators - specifically, Joey Gonzalez was recently an Intern at Yahoo! > and looked at similar directions. > I will try to learn the technical details better to see how this > interoperability works. > Who is working on this project in case we need more details? > > Thanks, > > Danny Bickson > > On Thu, Sep 1, 2011 at 7:26 PM, Josh Patterson <[email protected]> wrote: > >> Danny, >> (Only tangentially understanding the internals of GraphLab) --- is >> there any interest in having this framework run as a first class >> citizen on hadoop (beside MR) similar to: >> >> MPI on hadoop >> https://issues.apache.org/jira/browse/MAPREDUCE-2911 >> >> via the new MRv2 framework? I think that would be a really interesting >> way to get GraphLab to work with Mahout as I see MRv2 as enabling a >> lot more functionality in Mahout as we move forward. >> >> Thoughts? >> >> JP >> >> > -- Twitter: @jpatanooga Solution Architect @ Cloudera hadoop: http://www.cloudera.com
