Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Sebastian Raschka
> Pardon me if I am saying something stupid, but isn't Theano/Tensorflow > about deep learning and not reinforcement learning. RL can be done with > deep learning, but it's more than that, and I suspect that it requires a > different API, in particular with the notion of actions. Sure, I understan

Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Kyle Kastner
Any RL package will have be heavily focused on non-iid data (timeseries, basically) with the additional difficulty of the agent effecting/interacting with the environment it is operating in. I agree with you Gael - many packages for "deep learning" also don't handle this type of data/these models (

Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Gael Varoquaux
Pardon me if I am saying something stupid, but isn't Theano/Tensorflow about deep learning and not reinforcement learning. RL can be done with deep learning, but it's more than that, and I suspect that it requires a different API, in particular with the notion of actions. G On Wed, Mar 02, 2016 a

Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Sebastian Raschka
You mean a scikit-like interface to Theano/Tensorflow? That’s actually what skflow intends to do. > On Mar 2, 2016, at 3:02 PM, Nadim Farhat wrote: > > I was just thinking the same but , how about just making pipelines to Theano > , TensorFlow ? > > On Wed, Mar 2, 2016 at 3:00 PM Sebastia

Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Gael Varoquaux
On Wed, Mar 02, 2016 at 11:34:17AM -0800, Jacob Schreiber wrote: > Reinforcement learning is an exciting field of machine learning, and you're > right that it seems underrepresented in Python. However, I don't think that it > falls within the strict scope of the scikit-learn API.  Indeed. There's

Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Nadim Farhat
I was just thinking the same but , how about just making pipelines to Theano , TensorFlow ? On Wed, Mar 2, 2016 at 3:00 PM Sebastian Raschka wrote: > I am not a core developer and thus really can’t comment about the scope of > scikit-learn here :P. But I am a curious about how to implement it

Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Sebastian Raschka
I am not a core developer and thus really can’t comment about the scope of scikit-learn here :P. But I am a curious about how to implement it in scikit-learn efficiently. I think an implementation based on Theano or TensorFlow may be a better place for such a module (maybe skflow, which has a s

Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Michał Koziarski
I see. Thank you for quick answer. 2016-03-02 20:31 GMT+01:00 Andreas Mueller : > > > On 03/02/2016 02:21 PM, Michał Koziarski wrote: > > As far as I can tell, except PyBrain (which doesn't seem to be > > actively developed) there are no reinforcement learning libraries in > > Python. I was wonde

Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Andreas Mueller
On 03/02/2016 02:21 PM, Michał Koziarski wrote: > As far as I can tell, except PyBrain (which doesn't seem to be > actively developed) there are no reinforcement learning libraries in > Python. I was wondering if community would be interested in using one > and making it a part of scikit-learn

Re: [Scikit-learn-general] GSoC Project Proposal: Reinforcement Learning Module

2016-03-02 Thread Jacob Schreiber
Reinforcement learning is an exciting field of machine learning, and you're right that it seems underrepresented in Python. However, I don't think that it falls within the strict scope of the scikit-learn API. On Wed, Mar 2, 2016 at 11:21 AM, Michał Koziarski wrote: > Hello everyone, > > As far