Re: MLlib: save models to HDFS?

2015-04-03 Thread Xiangrui Meng
In 1.3, you can use model.save(sc, "hdfs path"). You can check the code examples here: http://spark.apache.org/docs/latest/mllib-collaborative-filtering.html#examples. -Xiangrui On Fri, Apr 3, 2015 at 2:17 PM, Justin Yip wrote: > Hello Zhou, > > You can look at the recommendation template of Pred

Re: MLlib: save models to HDFS?

2015-04-03 Thread Justin Yip
Hello Zhou, You can look at the recommendation template of PredictionIO. PredictionIO is built on the top of spark. And this template illustrates how you can save the ALS model to HDFS and the reload it later. Ju

MLlib: save models to HDFS?

2015-04-03 Thread S. Zhou
I am new to MLib so I have a basic question: is it possible to save MLlib models (particularly CF models) to HDFS and then reload it later? If yes, could u share some sample code (I could not find it in MLlib tutorial). Thanks!