Re: Issues with AbstractParams

2014-11-05 Thread Joseph Bradley
I'm making a JIRA and will then do a quick PR for it. (Thanks both for pointing out the bug & fix!) On Tue, Nov 4, 2014 at 10:55 PM, Sean Owen wrote: > I don't think it's anything to do with AbstractParams. The problem is > MovieLensALS$Params, which is a case class without default > constructo

Re: Issues with AbstractParams

2014-11-04 Thread Sean Owen
I don't think it's anything to do with AbstractParams. The problem is MovieLensALS$Params, which is a case class without default constructor. It is not Serializable. However you can see it gets used in an RDD function: val ratings = sc.textFile(params.input).map { line => val fields = line.spli

Re: Issues with AbstractParams

2014-11-04 Thread Joseph Bradley
Hi Deb, Thanks for pointing it out! I don't know of a JIRA for it now, so it would be great if you could open one. I'm looking into the bug... Joseph On Tue, Nov 4, 2014 at 4:42 PM, Debasish Das wrote: > Hi, > > I build the master today and I was testing IR statistics on movielens > dataset (o

Issues with AbstractParams

2014-11-04 Thread Debasish Das
Hi, I build the master today and I was testing IR statistics on movielens dataset (open up a PR in a bit)... Right now in the master examples.MovieLensALS, case class Params extends AbstractParam[Params] On my localhost spark, if I run as follows it fails: ./bin/spark-submit --master spark:// t