Re: Collaborative filtering steps in spark

2017-03-29 Thread chris snow
Thanks Nick, that helps my with my understanding of ALS. On Wed, 29 Mar 2017 at 14:41, Nick Pentreath wrote: > No, it does a random initialization. It does use a slightly different > approach from pure normal random - it chooses non-negative draws which > results in very slightly better results

Re: Collaborative filtering steps in spark

2017-03-29 Thread Nick Pentreath
No, it does a random initialization. It does use a slightly different approach from pure normal random - it chooses non-negative draws which results in very slightly better results empirically. In practice I'm not sure if the average rating approach will make a big difference (it's been a long whi

Collaborative filtering steps in spark

2017-03-26 Thread chris snow
In the paper “Large-Scale Parallel Collaborative Filtering for the Netflix Prize”, the following steps are described for ALS: Step 1 Initialize matrix M by assigning the average rating for that movie as the first row, and small random numbers for the remaining entries. Step 2 Fix M, Solve U by min