2012/6/18 Andreas Mueller <[email protected]>: > Hey David. > Olivier dug up this paper by LeCun's group: > http://users.ics.aalto.fi/kcho/papers/icml11.pdf > I think this might be quite interesting for the MLP.
Err, no. The paper I mentioned is even newer: http://arxiv.org/abs/1206.1106 Just to make it more explicit about the paper content, the title is: "No More Pesky Learning Rates" and it's a method for estimating the optimal learning rate schedule online from the data, while learning a model using SGD with a smooth loss (convex or not). It's a pre-print for NIPS 2012. It looks very promising. It would great to try and reproduce some of their empirical results. -- Olivier http://twitter.com/ogrisel - http://github.com/ogrisel ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
