How big is your input? I am not sure this necessarily scales to tens of millions of data points, no. A distributed implementation is being created which could be more appropriate.
On Fri, Jun 18, 2010 at 11:33 AM, Tamas Jambor <[email protected]> wrote: > hi, > > i am trying to run an SVD recommender with the netflix dataset, first I am > trying to read the data to a GenericDataModel object, for some reason I > always run out of memory, even if I assign quite a lot of memory to the task > (e.g 10gb). is there a more efficient way to run this task? > > thanks, > Tamas >
