There was an interview with Ilya Sutskever about deep learning (
http://yyue.blogspot.ru/2015/01/a-brief-overview-of-deep-learning.html),
where he states that DL's success can be attributed to 3 main breakthroughs:
1. Computing resources.
2. Large datasets.
3. Tricks of the trade, discovered in recent years.
The first bullet is the most important, IMO. Deep Learning is usually done
on GPU (or, in Jeff Dean's style — on a cluster), and even in that case it
takes hours to run. I haven't seen any mentions of GPU support in sklearn,
so I assume there's none.
I doubt that DL's models would be useful without such computing power.
As to (current) Deep Learning models, according to my understanding, even
though RBMs and AutoEncoders might have fell out of interest, convolutional
and recurrent networks are still around, and are used extensively.
On Thu, Feb 12, 2015 at 1:24 AM, Christof Angermueller <
c.angermuel...@gmail.com> wrote:
> as far as I know, sklearn has only an RBM module, but does not support
> multilayer perceptrons (MLPs), autoencoder, or recurrent neural networks.
> Are there any plans do extend sklearn by some neural network related
> modules?
> There was a GSoC project on neural networks last year (
> http://goo.gl/buHkyv), but I think it was not merged in. Instead of
> creating own modules, one might also provide an interface to theano, or
> other nnet libraries.
>
> Christof
>
> On 10/02/2015 15:41, Andy wrote:
>
> I'd say this years JMLR is too fresh ;)
>
>
> On 02/09/2015 04:31 PM, Ronnie Ghose wrote:
>
> are we interested in more discriminant methods? There were a few more @
> JMLR this year
>
> On Mon, Feb 9, 2015 at 4:28 PM, Alexandre Gramfort <
> alexandre.gramf...@m4x.org> wrote:
>
>> please wait a bit so we finalize the list. It's not definitive.
>>
>> A
>>
>> On Mon, Feb 9, 2015 at 6:39 PM, ragv ragv <rag...@gmail.com> wrote:
>> > Hi,
>> >
>> > I saw implementing GAMs as one of the suggested topics for GSoC 2015.
>> > Could I take that up? I saw your ( Alex's ) name under that. If yes,
>> > please let me know I'll start working on the same and if you permit me
>> > to, I'll start a wiki page for my proposal and timeline.
>> >
>> > Thanks
>> > ragv
>> >
>> >
>> ------------------------------------------------------------------------------
>> > Dive into the World of Parallel Programming. The Go Parallel Website,
>> > sponsored by Intel and developed in partnership with Slashdot Media, is
>> your
>> > hub for all things parallel software development, from weekly thought
>> > leadership blogs to news, videos, case studies, tutorials and more.
>> Take a
>> > look and join the conversation now. http://goparallel.sourceforge.net/
>> > _______________________________________________
>> > Scikit-learn-general mailing list
>> > Scikit-learn-general@lists.sourceforge.net
>> > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>>
>>
>> ------------------------------------------------------------------------------
>> Dive into the World of Parallel Programming. The Go Parallel Website,
>> sponsored by Intel and developed in partnership with Slashdot Media, is
>> your
>> hub for all things parallel software development, from weekly thought
>> leadership blogs to news, videos, case studies, tutorials and more. Take a
>> look and join the conversation now. http://goparallel.sourceforge.net/
>> _______________________________________________
>> Scikit-learn-general mailing list
>> Scikit-learn-general@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>>
>
>
>
> ------------------------------------------------------------------------------
> Dive into the World of Parallel Programming. The Go Parallel Website,
> sponsored by Intel and developed in partnership with Slashdot Media, is your
> hub for all things parallel software development, from weekly thought
> leadership blogs to news, videos, case studies, tutorials and more. Take a
> look and join the conversation now. http://goparallel.sourceforge.net/
>
>
>
> _______________________________________________
> Scikit-learn-general mailing
> listScikit-learn-general@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>
>
>
>
> ------------------------------------------------------------------------------
> Dive into the World of Parallel Programming. The Go Parallel Website,
> sponsored by Intel and developed in partnership with Slashdot Media, is your
> hub for all things parallel software development, from weekly thought
> leadership blogs to news, videos, case studies, tutorials and more. Take a
> look and join the conversation now. http://goparallel.sourceforge.net/
>
>
>
> _______________________________________________
> Scikit-learn-general mailing
> listScikit-learn-general@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>
>
> --
> Christof Angermuellercangermueller@gmail.comhttp://cangermueller.com
>
>
>
> ------------------------------------------------------------------------------
> Dive into the World of Parallel Programming. The Go Parallel Website,
> sponsored by Intel and developed in partnership with Slashdot Media, is
> your
> hub for all things parallel software development, from weekly thought
> leadership blogs to news, videos, case studies, tutorials and more. Take a
> look and join the conversation now. http://goparallel.sourceforge.net/
> _______________________________________________
> Scikit-learn-general mailing list
> Scikit-learn-general@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>
>
------------------------------------------------------------------------------
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/
_______________________________________________
Scikit-learn-general mailing list
Scikit-learn-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
