RE: MatrixFactorizationModel serialization

2015-01-07 Thread Ganelin, Ilya
com>] Sent: Wednesday, January 07, 2015 10:54 PM Eastern Standard Time To: user@spark.apache.org Subject: Re: MatrixFactorizationModel serialization I save and reload model like this: val bestModel = ALS.train(training, rank, numIter, lambda) bestModel.get.userFeatures.saveAsObjectFile

Re: MatrixFactorizationModel serialization

2015-01-07 Thread wanbo
n$.main(ModelDeserialization.scala:138) at com.ft.jobs.test.ModelDeserialization.main(ModelDeserialization.scala) ... 5 more Have fixed this issue? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/MatrixFactorizationModel-serialization-tp183

Re: MatrixFactorizationModel serialization

2014-11-07 Thread Sean Owen
Serializable like a Java object? no, it's an RDD. A factored matrix model is huge, unlike most models, and is not a local object. You can of course persist the RDDs to storage manually and read them back. On Fri, Nov 7, 2014 at 11:33 PM, Dariusz Kobylarz wrote: > I am trying to persist MatrixFact

MatrixFactorizationModel serialization

2014-11-07 Thread Dariusz Kobylarz
I am trying to persist MatrixFactorizationModel (Collaborative Filtering example) and use it in another script to evaluate/apply it. This is the exception I get when I try to use a deserialized model instance: Exception in thread "main" java.lang.NullPointerException at org.apache.spark.rdd