com>]
Sent: Wednesday, January 07, 2015 10:54 PM Eastern Standard Time
To: user@spark.apache.org
Subject: Re: MatrixFactorizationModel serialization
I save and reload model like this:
val bestModel = ALS.train(training, rank, numIter, lambda)
bestModel.get.userFeatures.saveAsObjectFile
I save and reload model like this:
val bestModel = ALS.train(training, rank, numIter, lambda)
bestModel.get.userFeatures.saveAsObjectFile("hdfs://***:9000/spark/results/userfeatures")
bestModel.get.productFeatures.saveAsObjectFile("hdfs://***:9000/spark/results/productfeatures")
val bestModel = o
Serializable like a Java object? no, it's an RDD. A factored matrix
model is huge, unlike most models, and is not a local object. You can
of course persist the RDDs to storage manually and read them back.
On Fri, Nov 7, 2014 at 11:33 PM, Dariusz Kobylarz
wrote:
> I am trying to persist MatrixFact
