MRv2 could be huge for Mahout. +1 for enabling additional computational models as they become feasible.
On Thu, Sep 1, 2011 at 11:26 AM, Josh Patterson <[email protected]> wrote: > Danny, > (Only tangentially understanding the internals of GraphLab) --- is > there any interest in having this framework run as a first class > citizen on hadoop (beside MR) similar to: > > MPI on hadoop > https://issues.apache.org/jira/browse/MAPREDUCE-2911 > > via the new MRv2 framework? I think that would be a really interesting > way to get GraphLab to work with Mahout as I see MRv2 as enabling a > lot more functionality in Mahout as we move forward. > > Thoughts? > > JP > > On Sun, Aug 28, 2011 at 10:44 AM, Danny Bickson <[email protected]> > wrote: > > Yes, it is not using map reduce - we have our own communication > > infrastructure written in C++. > > You can learn more by looking at http://graphlab.org > > > > 2011/8/28 myn <[email protected]> > > > >> Is that a non hadoop mapreduce project? > >> > >> > >> At 2011-08-28 21:32:51,myn <[email protected]> wrote: > >> > >> > >> > >> sorry i can`t visit the page > >> > >> > http://bickson.blogspot.com/2011/08/graphlab-and-mahout-compatability.html > >> > >> At 2011-08-28 20:13:06,"Danny Bickson" <[email protected]> wrote: > >> >Hi Mahouters! > >> >In the last couple of months we are trying to improve CMU GraphLab's > large > >> >scale machine learning (http://graphlab.org) compatibility with > Mahout. > >> >As a first step, we changed our open source license to Apache. Now we > are > >> >working on writing some of the GraphLab wrapper code in Java, > >> >thus allowing for better interaction between the projects. Our vision > is > >> to > >> >use Mahout for the inherently parallel tasks for large scale data it is > >> very > >> >good at, > >> >while having GraphLab functionality of more complex interactions of > data. > >> > > >> >I am looking for any Mahout users who have large scale matrices that > are > >> >factorized using Mahout SVD, who want to try out GraphLab SVD solver. > >> >I wrote some code to allow for easy transition between Mahout > >> >SequetialAccessSparseVector to GraphLab's binary format. If anyone > wants > >> to > >> >try > >> >it out, instructions are found on: > >> > > >> > http://bickson.blogspot.com/2011/08/graphlab-and-mahout-compatability.html > >> >Any feedback is welcome! > >> > > >> >- Danny Bickson > >> > >> > >> > >> > > > > > > -- > Twitter: @jpatanooga > Solution Architect @ Cloudera > hadoop: http://www.cloudera.com >
