Sebastian, what is IIRC?
On Sat, Sep 7, 2013 at 8:24 PM, Sebastian Schelter <ssc.o...@googlemail.com> wrote: > IIRC the algorithm behind ParallelSGDFactorizer needs shared memory, > which is not given in a shared-nothing environment. > > > On 07.09.2013 19:08, Tevfik Aytekin wrote: >> Hi, >> There seems to be no Hadoop implementation of ParallelSGDFactorizer. >> ALSWRFactorizer has a Hadoop implementation. >> >> ParallelSGDFactorizer (since it is based on stochastic gradient >> descent) is much faster than ALSWRFactorizer. >> >> I don't know Hadoop much. But it seems to me that a Hadoop >> implementation of ParallelSGDFactorizer will also be much faster than >> the Hadoop implementaion of ALSWRFactorizer. >> >> Is there a specific reason for why there is no Hadoop implementation >> of ParallelSGDFactorizer? Is it because since Hadoop operations are >> already slow the slowness of ALSWRFactorizer does not matter much. Or >> is it simply because nobody has implemented it yet? >> >> Thanks >> Tevfik >> >
