Re: [Computer-go] Deep Zen - do we have a race now?

[Michael Markefka]

Hi Petr,

to clarify a bit:

pylearn2 specifically comes with a script to convert a model trained
on a GPU into a version that runs on the CPU. This doesn't work very
well though and the documentation points that out too. According to
the dev commens that is down to how Theano, the framework pylearn2 is
based on, handles its shared variables und the CUDA variables need to
be converted to Theano tensor variables.

Just wanted to advise caution that this process working flawlessly
isn't necessarily given in every NN lib. If Caffe does this well, then
David shouldn't have any problem of course and this warning doesn't
apply here.

-Michael

On Wed, Mar 2, 2016 at 8:57 AM, Petr Baudis  wrote:
> On Tue, Mar 01, 2016 at 02:51:03PM -0800, David Fotland wrote:
>> > Also, if you are training on a GPU you can probably avoid a lot of
>> > hassle if you expect to run it on a GPU as well. I don't know how other
>> > NN implementations handle it, but the GPU-to-CPU conversion script that
>> > comes with the Theano-based pylearn2 kit doesn't work very reliably.
>> I'll keep it in mind.  I'm using caffe, which has a compile-time flag, so 
>> I'm not sure it will work with GPU enabled on a machine without a GPU.
>
> I'm not sure about Michael's specific problem, but in my experience,
> there is no trouble at all transferring stuff between CPU and GPU - your
> model is, after all, just the weight matrices.  In Caffe, you should
> be able to switch between GPU and CPU completely freely.
>
> Petr Baudis
> ___
> Computer-go mailing list
> Computer-go@computer-go.org
> http://computer-go.org/mailman/listinfo/computer-go
___
Computer-go mailing list
Computer-go@computer-go.org
http://computer-go.org/mailman/listinfo/computer-go

Re: [Computer-go] Deep Zen - do we have a race now?

[Petr Baudis]

On Tue, Mar 01, 2016 at 02:51:03PM -0800, David Fotland wrote:
> > Also, if you are training on a GPU you can probably avoid a lot of
> > hassle if you expect to run it on a GPU as well. I don't know how other
> > NN implementations handle it, but the GPU-to-CPU conversion script that
> > comes with the Theano-based pylearn2 kit doesn't work very reliably.
> I'll keep it in mind.  I'm using caffe, which has a compile-time flag, so I'm 
> not sure it will work with GPU enabled on a machine without a GPU.

I'm not sure about Michael's specific problem, but in my experience,
there is no trouble at all transferring stuff between CPU and GPU - your
model is, after all, just the weight matrices.  In Caffe, you should
be able to switch between GPU and CPU completely freely.

Petr Baudis
___
Computer-go mailing list
Computer-go@computer-go.org
http://computer-go.org/mailman/listinfo/computer-go

Re: [Computer-go] Deep Zen - do we have a race now?

[David Fotland]

I'll keep it in mind.  I'm using caffe, which has a compile-time flag, so I'm 
not sure it will work with GPU enabled on a machine without a GPU.

David

> -Original Message-
> From: Computer-go [mailto:computer-go-boun...@computer-go.org] On Behalf
> Of Michael Markefka
> Sent: Tuesday, March 01, 2016 2:21 PM
> To: computer-go@computer-go.org
> Subject: Re: [Computer-go] Deep Zen - do we have a race now?
> 
> Would be nice to have it as an option. My desktop PC and my laptop both
> have CUDA-enabled graphics, and that isn't uncommon anymore.
> 
> Also, if you are training on a GPU you can probably avoid a lot of
> hassle if you expect to run it on a GPU as well. I don't know how other
> NN implementations handle it, but the GPU-to-CPU conversion script that
> comes with the Theano-based pylearn2 kit doesn't work very reliably.
> 
> Also, even quite big nets probably can be run on modest GPUs reasonably
> well (within memory bounds). It's the training where the size really
> hurts.
> 
> On Tue, Mar 1, 2016 at 6:19 PM, Petr Baudis <pa...@ucw.cz> wrote:
> > On Tue, Mar 01, 2016 at 09:14:39AM -0800, David Fotland wrote:
> >> Very interesting, but it should also mention Aya.
> >>
> >> I'm working on this as well, but I haven t bought any hardware yet.
> My goal is not to get 7 dan on expensive hardware, but to get as much
> strength as I can on standard PC hardware.  I'll be looking at much
> smaller nets, that don t need a GPU to run.  I'll have to buy a GPU for
> training.
> >
> > But I think most people who play Go are also fans of computer games
> > that often do use GPUs. :-)  Of course, it's something totally
> > different from NVidia Keplers, but still the step up from a CPU is
> tremendous.
> >
> > Petr Baudis
> > ___
> > Computer-go mailing list
> > Computer-go@computer-go.org
> > http://computer-go.org/mailman/listinfo/computer-go
> ___
> Computer-go mailing list
> Computer-go@computer-go.org
> http://computer-go.org/mailman/listinfo/computer-go

___
Computer-go mailing list
Computer-go@computer-go.org
http://computer-go.org/mailman/listinfo/computer-go

Re: [Computer-go] Deep Zen - do we have a race now?

[James Guo]

any news on open source deep learning type of go program?


  From: Petr Baudis <pa...@ucw.cz>
 To: computer-go@computer-go.org 
 Sent: Wednesday, March 2, 2016 1:19 AM
 Subject: Re: [Computer-go] Deep Zen - do we have a race now?
   
On Tue, Mar 01, 2016 at 09:14:39AM -0800, David Fotland wrote:
> Very interesting, but it should also mention Aya.  
> 
> I'm working on this as well, but I haven’t bought any hardware yet.  My goal 
> is not to get 7 dan on expensive hardware, but to get as much strength as I 
> can on standard PC hardware.  I'll be looking at much smaller nets, that 
> don’t need a GPU to run.  I'll have to buy a GPU for training.

But I think most people who play Go are also fans of computer games that
often do use GPUs. :-)  Of course, it's something totally different from
NVidia Keplers, but still the step up from a CPU is tremendous.

                Petr Baudis
___
Computer-go mailing list
Computer-go@computer-go.org
http://computer-go.org/mailman/listinfo/computer-go

  ___
Computer-go mailing list
Computer-go@computer-go.org
http://computer-go.org/mailman/listinfo/computer-go

Re: [Computer-go] Deep Zen - do we have a race now?

[Petr Baudis]

On Tue, Mar 01, 2016 at 09:14:39AM -0800, David Fotland wrote:
> Very interesting, but it should also mention Aya.  
> 
> I'm working on this as well, but I haven’t bought any hardware yet.  My goal 
> is not to get 7 dan on expensive hardware, but to get as much strength as I 
> can on standard PC hardware.  I'll be looking at much smaller nets, that 
> don’t need a GPU to run.  I'll have to buy a GPU for training.

But I think most people who play Go are also fans of computer games that
often do use GPUs. :-)  Of course, it's something totally different from
NVidia Keplers, but still the step up from a CPU is tremendous.

Petr Baudis
___
Computer-go mailing list
Computer-go@computer-go.org
http://computer-go.org/mailman/listinfo/computer-go

Re: [Computer-go] Deep Zen - do we have a race now?

[David Fotland]

Very interesting, but it should also mention Aya.  

I'm working on this as well, but I haven’t bought any hardware yet.  My goal is 
not to get 7 dan on expensive hardware, but to get as much strength as I can on 
standard PC hardware.  I'll be looking at much smaller nets, that don’t need a 
GPU to run.  I'll have to buy a GPU for training.

David

> -Original Message-
> From: Computer-go [mailto:computer-go-boun...@computer-go.org] On Behalf
> Of "Ingo Althöfer"
> Sent: Tuesday, March 01, 2016 8:45 AM
> To: computer-go@computer-go.org
> Subject: [Computer-go] Deep Zen - do we have a race now?
> 
> Read here:
> http://www.lifein19x19.com/forum/viewtopic.php?p=199532#p199532
> 
> Wonderfully exciting times!
> Ingo.
> ___
> Computer-go mailing list
> Computer-go@computer-go.org
> http://computer-go.org/mailman/listinfo/computer-go

___
Computer-go mailing list
Computer-go@computer-go.org
http://computer-go.org/mailman/listinfo/computer-go