On Wed, Jun 9, 2010 at 12:34 PM, Richard Simon Just < [email protected]> wrote: > > I'm not sure what kind of regularization we're doing here, actually... >> >> >> >> > I guess what I'm asking is, would regularization normally be a part of the > normalization process? or are they completely separate? In the literature > when normalization is talked about they generally seem to be talking about > imputation and the filling in of the null entries. Whereas when > regularization is mentioned it's more gradient descent.
That's my understanding as well, actually. Regularization is totally separate than normalization - the former is done per iteration, and the latter is done before the first iteration starts. > matrix.timesSquared(Vector v) == >> (matrix.transpose().times(matrix)).times(v) >> >> in one pass over the matrix, without ever computing the transpose or >> matrix >> multiplication two matrices (and on a DistributedRowMatrix, it does this >> in >> one MapReduce pass over the data). >> >> -jake >> >> >> > That's awesome! > Heh, thanks. I get far too much joy out of chopping down the number of MapReduce passes required for a computation. :) -jake
