Re: [R] lasso for variable selection

2006-08-14 Thread Liaw, Andy
For importance it's probably best to stick with absolute values of coefficients, instead of value of the penalty parameter for which the coefficients changed to non-zero. Friedman skipped a lot of details on his rule ensemble in that talk, due to time constraint. In his implementation he was

[R] lasso for variable selection

2006-08-12 Thread zubin
Attended JSM last week and Friedman mentioned the use of LASSO for variable selection (he uses it for rules ensembles). I am an econometrician and not familiar with, i started running the examples in R this week and you get to the plots section of the LARS package. Plots of beta/max(beta)

Re: [R] lasso for variable selection

2006-08-12 Thread Wensui Liu
Zubin, my understanding about lasso is that it is a restricted version of regression, where minimization of sse subject to sum(abs(beta)) upper limit such that for unimportant feature, its beta will be restricted by ZERO. the whole game of lasso is to find the proper upper limit. I think in