Re: [Scikit-learn-general] Online Non Negative Matrix Factorization GSoC

2012-03-23 Thread Immanuel B
>hum it's seems surprising that a coordinate descent procedure blows up the >memory but i'll have to read the paper. When I find the time … > >I had more in mind the glmnet approach for multinomial logistic regression >which scales pretty well AFIAK These remarks were quite useful to me, thanks. I

Re: [Scikit-learn-general] Online Non Negative Matrix Factorization GSoC

2012-03-21 Thread Gael Varoquaux
On Wed, Mar 21, 2012 at 06:42:36PM +0100, Alexandre Gramfort wrote: > > In short, I think it could be interesting to implement the scout method too: > > "We show that ridge regression, the lasso, and the elastic net are > > special cases of covariance-regularized regression" > > http://www-stat.sta

Re: [Scikit-learn-general] Online Non Negative Matrix Factorization GSoC

2012-03-21 Thread Alexandre Gramfort
> Okay, that sounds reasonable to me too. > It appears to me that it might be in everyone interest if I apply for > a different project. I'm considering "Coordinated descent in linear > models beyond squared loss (eg Logistic)" > I'm currently working on a p>>N problem using the R scout package, >

Re: [Scikit-learn-general] Online Non Negative Matrix Factorization GSoC

2012-03-21 Thread Immanuel B
2012/3/21 Gael Varoquaux : > On Wed, Mar 21, 2012 at 12:24:39PM +0900, Mathieu Blondel wrote: >> If the online NMF and SGD-based matrix factorization proposals are >> merged as I suggested before, I think it would make a decent GSOC >> project. Besides, if two different students were to work on the

Re: [Scikit-learn-general] Online Non Negative Matrix Factorization GSoC

2012-03-20 Thread Gael Varoquaux
On Wed, Mar 21, 2012 at 12:24:39PM +0900, Mathieu Blondel wrote: > If the online NMF and SGD-based matrix factorization proposals are > merged as I suggested before, I think it would make a decent GSOC > project. Besides, if two different students were to work on the two > proposals in parallel, I

Re: [Scikit-learn-general] Online Non Negative Matrix Factorization GSoC

2012-03-20 Thread Mathieu Blondel
On Wed, Mar 21, 2012 at 5:23 AM, Gael Varoquaux wrote: > My gut feeling about your project is that it is an interesting proposal, > but idealy a GSOC project should be more ambitious than a single > algorithm. You could consider a full application problem that the > algorithm is trying to solve a

Re: [Scikit-learn-general] Online Non Negative Matrix Factorization GSoC

2012-03-20 Thread Olivier Grisel
Le 20 mars 2012 20:51, Immanuel a écrit : > Hello all, > > I followed the mailing list and poked around in the source code for the > last couple of week. > Now, I'm absolutely sure that I would enjoy to work on scikit-learn as > GSoC project. > > I especially like the proposed online NMF project,

Re: [Scikit-learn-general] Online Non Negative Matrix Factorization GSoC

2012-03-20 Thread Gael Varoquaux
Hi Immanuel, My gut feeling about your project is that it is an interesting proposal, but idealy a GSOC project should be more ambitious than a single algorithm. You could consider a full application problem that the algorithm is trying to solve and contribute a few different algorithms. This is w

[Scikit-learn-general] Online Non Negative Matrix Factorization GSoC

2012-03-20 Thread Immanuel
Hello all, I followed the mailing list and poked around in the source code for the last couple of week. Now, I'm absolutely sure that I would enjoy to work on scikit-learn as GSoC project. I especially like the proposed online NMF project, could you enlighten me on the following points? There wa