Try to set lambda to 0.1. -Xiangrui On Mon, Feb 23, 2015 at 3:06 PM, Krishna Sankar <[email protected]> wrote: > The RSME varies a little bit between the versions. > Partitioned the training,validation,test set like so: > > training = ratings_rdd_01.filter(lambda x: (x[3] % 10) < 6) > validation = ratings_rdd_01.filter(lambda x: (x[3] % 10) >= 6 and (x[3] % > 10) < 8) > test = ratings_rdd_01.filter(lambda x: (x[3] % 10) >= 8) > Validation MSE : > > # 1.3.0 Mean Squared Error = 0.871456869392 > # 1.2.1 Mean Squared Error = 0.877305629074 > > Itertools results: > > 1.3.0 - RSME = 1.354839 (rank = 8 and lambda = 1.0, and numIter = 20) > 1.1.1 - RSME = 1.335831 (rank = 8 and lambda = 1.0, and numIter = 10) > > Cheers > <k/> > > On Mon, Feb 23, 2015 at 12:37 PM, Xiangrui Meng <[email protected]> wrote: >> >> Which Spark version did you use? Btw, there are three datasets from >> MovieLens. The tutorial used the medium one (1 million). -Xiangrui >> >> On Mon, Feb 23, 2015 at 8:36 AM, poiuytrez <[email protected]> >> wrote: >> > What do you mean? >> > >> > >> > >> > -- >> > View this message in context: >> > http://apache-spark-user-list.1001560.n3.nabble.com/Movie-Recommendation-tutorial-tp21769p21771.html >> > Sent from the Apache Spark User List mailing list archive at Nabble.com. >> > >> > --------------------------------------------------------------------- >> > To unsubscribe, e-mail: [email protected] >> > For additional commands, e-mail: [email protected] >> > >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> >
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
