Hi Fred, are multiple GPUs on Windows supported if I use each GPU to train a separate network? For example, can I launch two theano programs, where one is using device=gpu0, and the other device=gpu1?
On Monday, March 13, 2017 at 3:15:04 PM UTC-7, nouiz wrote: > > Hi, > > For many reasons, multi GPU on Windows don't work. Nvidia don't have good > support for it, so event if we wanted to support it, it would be hard and > much less efficient. > > The problems is at least that your GPU is very old and don't have much > memory. Using two of them will not help you much. The multi GPU that Theano > currently support via platoon would help your case. It support only data > parallelism. > > Fred > > Le sam. 11 mars 2017 17:40, Ravi Teja <[email protected] <javascript:>> a > écrit : > >> Hi all, >> >> >> I am a beginner in deep learning/theano/keras.I'm trying to figure out >> how to use multiple gpus on windows 7. I've had success installing >> Theano,keras(as described in this post How do I install Keras and Theano >> in Anaconda Python on Windows? >> <http://stackoverflow.com/questions/34097988/how-do-i-install-keras-and-theano-in-anaconda-python-on-windows>) >> >> and using one gpu. I want to use both my gpus >> >> Following are the details of configs and versions >> >> Python - 2.7(Anaconda-4.3.14,Windows-64bit) ,CUDA - 7.5.17 ,Theano - >> 0.9.0rc3 ,keras - 1.2.2 ,pycuda - 2016.1.2+cuda7518 ,gpu - Geforce GTX >> 480(2 of them) >> >> Theano configuration is as below .theanorc.txt >> >> >> [global] >> floatX = float32 >> device = gpu >> [nvcc] >> flags=-LC:\ProgramData\Anaconda2\libs >> compiler_bindir=C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\bin >> [lib] >> cnmem=0.8 >> >> >> Currently I'm able to use only one GPU and I am getting memory error as >> below when I try to fit the model >> >> MemoryError: ('Error allocating 411041792 bytes of device memory >> (CNMEM_STATUS_OUT_OF_MEMORY).', "you might consider using >> 'theano.shared(..., borrow=True)'") >> >> >> Does using 2 gpus solve the problem(if yes, how do I enable the second >> one?) or is my model too big ? >> >> >> >> Thank You >> >> -- >> >> --- >> You received this message because you are subscribed to the Google Groups >> "theano-users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> For more options, visit https://groups.google.com/d/optout. >> > -- --- You received this message because you are subscribed to the Google Groups "theano-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
