[theano-users] Shared variable not freeing memory after each code run

2016-08-25 Thread Michael Klachko
I tried running this simple code which copies two large arrays to GPU memory for dot product computation. import numpy as np import theano import theano.tensor as T a = np.asarray(np.random.uniform(-1,1, (1,4)), dtype=np.float32) b = np.asarray(np.random.uniform(-1,1, (4,2)),

Re: [theano-users] How to reproduce training results?

2016-11-09 Thread Michael Klachko
Andre, can you please post your theano config and your convnet parameters? To debug this I would first try running on CPU only, then MLP, then convnet with no pooling and tanh, with CuDNN disabled, then partially enable one thing at a time. Also, check the obvious things like using the same

Re: [theano-users] Re: Is CuDnn 5105 supported ?

2016-11-09 Thread Michael Klachko
nday, October 24, 2016 at 9:38:17 AM UTC-7, nouiz wrote: >>> >>> What errors do you have? Delete your Theano cache, just in case and be >>> sure to use Theano dev version. The last release don't support it I think. >>> >>> Fred >>> >

Re: [theano-users] Re: Is CuDnn 5105 supported ?

2016-11-09 Thread Michael Klachko
I am getting a 98% gpu >>> tutilization with cudnn 5105. If I use cuda backend, I am only getting >>> about 35% utilization. >>> Anyidea why this might be so ? >>> >>> On Monday, October 24, 2016 at 9:38:17 AM UTC-7, nouiz wrote: >>>> >&

Re: [theano-users] Re: Is CuDnn 5105 supported ?

2016-11-10 Thread Michael Klachko
it can ? > > On Wednesday, November 9, 2016 at 5:36:14 PM UTC-7, Michael Klachko wrote: >> >> Ragav, so when GPU is 98% utilized, is the training faster than when it's >> 35% utilized? Have you timed it? >> >> On Wed, Nov 9, 2016 at 4:09 PM, Ragav Venkatesan <rag

[theano-users] How to find Float64 Variable?

2016-10-24 Thread Michael Klachko
I enabled warn_float64 flag in theano config, and now when I'm running my neural net code, I'm getting the following: c:\Theano\theano\gof\graph.py:447: UserWarning: You are creating a TensorVariable with float64 dtype. You requested an action via the Theano flag

[theano-users] Re: How to find Float64 Variable?

2016-10-24 Thread Michael Klachko
. I added dtype=theano.config.floatX and the warning disappeared. On Monday, October 24, 2016 at 8:23:01 AM UTC-7, Michael Klachko wrote: > > I enabled warn_float64 flag in theano config, and now when I'm running my > neural net code, I'm getting the following: > > c:\Th

Re: [theano-users] Re: Is CuDnn 5105 supported ?

2016-11-14 Thread Michael Klachko
san <ragav.ve...@gmail.com >>> > wrote: >>> >>>> Both are using CUdNNs.. I am wondering if some ops are running on the >>>> CPU, how do I find that out ? >>>> >>>> On Friday, November 11, 2016 at 10:00:39 PM UTC-7, Michael K

Re: [theano-users] Re: Is CuDnn 5105 supported ?

2016-11-12 Thread Michael Klachko
ow do I find that out ? > > On Friday, November 11, 2016 at 10:00:39 PM UTC-7, Michael Klachko wrote: >> >> Do both versions use CuDNN? If gpu0 version didn't use it, that would >> explain the difference. Also, look at CPU usage for gpu0 version - it could >> be that

Re: [theano-users] different results for different runs on same GPU

2016-11-11 Thread Michael Klachko
This is an old issue, see: https://groups.google.com/forum/#!topic/theano-users/Q9tD4Af_7ho On Friday, November 11, 2016 at 10:07:22 AM UTC-8, Amin Farajian wrote: > > Hi Fred, > I just followed your suggestion and hard coded the changes in my Theano > package, and ran multiple experiments

Re: [theano-users] Re: Is CuDnn 5105 supported ?

2016-11-11 Thread Michael Klachko
cc.allowgc > =True. > > On Thursday, November 10, 2016 at 4:47:38 PM UTC-7, Michael Klachko wrote: >> >> Yes. It depends on the size of your network/input - the smaller it is, >> the harder it is to keep 3k cores busy all the time. >> Regarding timing, you don't need to write muc

[theano-users] Re: Theano 0.9.0rc1 on Windows 10 x64 and Ubuntu 16.04 have same pygpu errors

2017-03-23 Thread Michael Klachko
I updated my CUDA from 7.5 to 8.0, and the error changed to: In [1]: import theano ERROR:theano.gpuarray:Could not initialize pygpu, support disabled Traceback (most recent call last): File "c:\Theano\theano\gpuarray\__init__.py", line 164, in use(config.device) File

[theano-users] Re: theano_alexnet "train.py"

2017-03-28 Thread Michael Klachko
Has anyone here trained Alexnet successfully on Imagenet dataset? I'm trying to decide if it's worth it trying to make it work with Theano, or switch to Tensorflow... -- --- You received this message because you are subscribed to the Google Groups "theano-users" group. To unsubscribe from

Re: [theano-users] Re: How to find Float64 Variable?

2017-03-25 Thread Michael Klachko
Oh, looks like my message got truncated. Here's the complete graph: C:\ProgramData\Miniconda2\lib\site-packages\theano\gof\type.py:405: UserWarning: You are creating a TensorVariable with float64 dtype. You requested an action via the Theano flag warn_float64={ignore,warn,raise,pdb}. return

Re: [theano-users] Re: How to find Float64 Variable?

2017-03-25 Thread Michael Klachko
I just updated to gpuarray backend, and suddenly I started seeing float64 warnings. I printed the graph (float64 shown in bold red below), then set it up so that float64 triggers pdb. However, I still can't figure out which variable it is. By using UP in pdb I eventually got to my training

Re: [theano-users] Re: theano_alexnet "train.py"

2017-03-28 Thread Michael Klachko
on images from ImageNet > standard dataset. Later I will post the errors. But I think that for some > people AlexNet with theano works. > > Goffredo > > Il 28/Mar/2017 19:14, "Michael Klachko" <michael...@gmail.com > > ha scritto: > >> Has anyone her

[theano-users] Re: The architecture of Theano

2017-03-28 Thread Michael Klachko
You can install everything using conda (use mingw's gcc instead of Visual Studio): http://deeplearning.net/software/theano/install_windows.html#requirements-installation-through-conda-recommended Here's the summary of the process: 1. install CUDA 2. copy the CuDNN files 3. install miniconda 4.

Re: [theano-users] Using multiple gpus on windows using theano,keras

2017-03-16 Thread Michael Klachko
Hi Fred, are multiple GPUs on Windows supported if I use each GPU to train a separate network? For example, can I launch two theano programs, where one is using device=gpu0, and the other device=gpu1? On Monday, March 13, 2017 at 3:15:04 PM UTC-7, nouiz wrote: > > Hi, > > For many reasons,

Re: [theano-users] Re: How to find Float64 Variable?

2017-04-11 Thread Michael Klachko
< frederic.bast...@gmail.com> wrote: > Just an updated, we fixed many such useless warning. Update Theano to the > dev version. If you still see them, tell us. > > Fred > > On Sat, Mar 25, 2017 at 4:22 AM Michael Klachko <michaelklac...@gmail.com> > wrote: > >&g

Re: [theano-users] Re: How to find Float64 Variable?

2017-04-27 Thread Michael Klachko
Data\Miniconda2\pkgs\theano-0.9.0-py27_0\Lib\site-packages\theano >> folder? >> >> On Tue, Apr 11, 2017 at 8:02 AM, Frédéric Bastien < >> frederic.bast...@gmail.com> wrote: >> >> Just an updated, we fixed many such useless warning. Update Theano to

Re: [theano-users] Re: Theano 0.9.0rc1 on Windows 10 x64 and Ubuntu 16.04 have same pygpu errors

2017-06-05 Thread Michael Klachko
. > Both theano and pygpu can be imported successfully, but implementing > pygpu.test() results in those errors. > > Can you post you workable .theanorc file? > > > On Tuesday, 28 March 2017 13:20:44 UTC-4, Michael Klachko wrote: > >> In my case, the problem was

Re: [theano-users] How to change the learning rate dynamically

2017-10-03 Thread Michael Klachko
The learning rate schedule is defined in this line: updates.append((l_r,0.95*l_r)), and is used in this line: train_model = theano.function([index], cost, updates=updates ... If you don't understand what's going on, read about theano functions. On Thursday, September 7, 2017 at 6:58:34 AM

[theano-users] Could not initialize pygpu error with CUDA 9.0 and latest Theano

2018-05-08 Thread Michael Klachko
I have CUDA 9.0 and CuDNN 7.0.5 on my Ubuntu 16.04, and Tensorflow works fine. In order to install theano, I first installed miniconda, then ran "conda install theano pygpu" and it seemed to have installed fine. However, here's what I get: $ python Python 3.6.5 |Anaconda, Inc.| (default,

Re: [theano-users] Could not initialize pygpu error with CUDA 9.0 and latest Theano

2018-05-10 Thread Michael Klachko
e cuda version installed to have TF working. > > Le jeu. 10 mai 2018 16:28, Michael Klachko <michael...@gmail.com > > a écrit : > >> After struggling with this error for a day, I decided to upgrade CUDA to >> 9.1 and CuDNN to 7.1. After that I got "your driver might