Getting incorrect weights for LinearRegression

2015-03-12 Thread EcoMotto Inc.
Hello, I am trying to run LinearRegression on a dummy data set, given below. Here I tried all different settings but I am still failing to reproduce desired coefficients. Please help me out, as I facing the same problem in my actual dataset. Thank you. This dataset is generated based on the simp

Re: Getting incorrect weights for LinearRegression

2015-03-13 Thread EcoMotto Inc.
: > > val w = weights.toArray > val intercept = w.takeRight(1).head() > val model = new LinearRegressionModel(Vectors.dense(w.dropRight(1)), > intercept) > > > Best, > Burak > > On Wed, Mar 11, 2015 at 11:59 AM, EcoMotto Inc. > wrote: > >> Hello, >&

Can LBFGS be used on streaming data?

2015-03-16 Thread EcoMotto Inc.
Hello, I am new to spark streaming API. I wanted to ask if I can apply LBFGS (with LeastSquaresGradient) on streaming data? Currently I am using forecahRDD for parsing through DStream and I am generating a model based on each RDD. Am I doing anything logically wrong here? Thank you. Sample Code:

Re: Can LBFGS be used on streaming data?

2015-03-17 Thread EcoMotto Inc.
y can use > existing MLLib optimization routines in this fairly direct way. Other > methods (such as KMeans) require a bit more reengineering. > > — Jeremy > > - > jeremyfreeman.net > @thefreemanlab > > On Mar 16, 2015, at 6:19 PM, EcoMotto Inc. w

Re: Can LBFGS be used on streaming data?

2015-03-25 Thread EcoMotto Inc.
he optimizer in the same order? > Difference in either could produce small differences in the resulting > weights, but that doesn’t mean it’s doing anything wrong. > > - > jeremyfreeman.net > @thefreemanlab > > On Mar 17, 2015, at 6:19 PM, EcoMotto Inc.

Re: Can LBFGS be used on streaming data?

2015-03-26 Thread EcoMotto Inc.
lem for the algorithm. > > Sincerely, > > DB Tsai > --- > Blog: https://www.dbtsai.com > > > On Mon, Mar 16, 2015 at 3:19 PM, EcoMotto Inc. > wrote: > > Hello, > > > > I am new to spark streaming API. &g