On Thu, Nov 17, 2011 at 10:03 PM, Alexandre Passos
<[email protected]> wrote:

> What do you mean by regularize weight here? Do an L1 truncation?

Yes.

For L2-regularization, doing the regularization before or after the
prediction doesn't change the sign of the prediction (as L2
regularization just needs to multiply the weight vector with a scalar)
but it should change the induced loss (and the gradient) so I guess
the order in which you do the steps should still changes the results.

I will try both settings and see if it has an actual impact.

Mathieu

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure 
contains a definitive record of customers, application performance, 
security threats, fraudulent activity, and more. Splunk takes this 
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d
_______________________________________________
Scikit-learn-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general

Reply via email to