FYI Mathieu and myself converged on this with Danny, believing it's the easiest move.
It could later be improved and extended with schemes that also use feature specific learning rates. any thought? Alex On Tue, Dec 2, 2014 at 2:48 PM, Daniel Sullivan <dbsulliva...@gmail.com> wrote: > Hey All, > > I've been looking at adding Adagrad to SGD for a while now. Alex, Mathieu > and I were discussing the possibility of having a separate class for Adagrad > entirely. The benefits of this would be that the implementation of SGD would > not get muddled up and Adagrad could be implemented in a much cleaner way > than the stochastic_gradient.py and sgd_fast.pyx files. The downside would > be the great duplication of code. Basically any bug in SGD would most likely > be a bug in AdaptiveSGD as well. > > It's just an idea I was toying around with, but I decided it would be a good > idea to reach out the community to get some feedback. Let me know what you > think. > > Danny > > ------------------------------------------------------------------------------ > Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server > from Actuate! Instantly Supercharge Your Business Reports and Dashboards > with Interactivity, Sharing, Native Excel Exports, App Integration & more > Get technology previously reserved for billion-dollar corporations, FREE > http://pubads.g.doubleclick.net/gampad/clk?id=157005751&iu=/4140/ostg.clktrk > _______________________________________________ > Scikit-learn-general mailing list > Scikit-learn-general@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general > ------------------------------------------------------------------------------ Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration & more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk _______________________________________________ Scikit-learn-general mailing list Scikit-learn-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
