Re: [Computer-go] *****SPAM***** Re: What hardware to use to train the DNN

2016-02-02 Thread Detlef Schmicker
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, this is a very difficult questions: I do have 100 batches (each 64) within 1 minute for the big facebook DCNN (384 layers in each of the 9 3x3 kernel two 128 5x5 and two 128 7x7 before that) What facebook calls an epoch is 400 of this (4 *

Re: [Computer-go] *****SPAM***** Re: What hardware to use to train the DNN

2016-02-02 Thread David Fotland
How long does it take to train one of your nets? Is it safe to assume that training time is roughly proportional to the number of neurons in the net? Thanks, David > -Original Message- > From: Computer-go [mailto:computer-go-boun...@computer-go.org] On Behalf > Of Detlef Schmicker >

Re: [Computer-go] *****SPAM***** Re: What hardware to use to train the DNN

2016-02-02 Thread Petri Pitkanen
At least on digital filter time increases non-linearly - you can think NN as non-linear FIR. And multilayer structure should make this harder, if you think of it . So some tricks to speed it up might be necessary. dunno about NN but on digital filters one trick was to train first part of filter