It is likely that some operations are still not yet supported on GPU
with float16. From your messages, ( would guess at least the following
ones:
- DiagonalSubtensor
- IncDiagonalSubtensor
I thought that random sampling was supported, but I see
"RandomFunction{binomial}", which is surprising. Are you using
shared_randomstreams.RandomStreams, or MRG_RandomStreams?
On Mon, Aug 29, 2016, [email protected] wrote:
>
> Fred,
> I entered cnmem = 1 in .theanorc with float16, but no message is showed as
> with float32 (CNMeM is enabled with initial size: 95.0% of memory) and the
> speed has not been improved.
> These are the outputs:
>
>
> USING FLOAT16
>
> .theanorc:
>
> [global]
> floatX = float16
> device = cuda
>
> [lib]
> cnmem=1
>
> [cuda]
> root = /usr/local/cuda-7.5
>
>
> [nvcc]
> fastmath=True
>
> optimizer = fast_compile
>
> output:
>
> Python 2.7.12 |Anaconda custom (64-bit)| (default, Jul 2 2016, 17:42:40)
> [GCC 4.4.7 20120313 (Red Hat 4.4.7-1)] on linux2
> Type "help", "copyright", "credits" or "license" for more information.
> Anaconda is brought to you by Continuum Analytics.
> Please check out: http://continuum.io/thanks and https://anaconda.org
> >>> runfile('/run/media/luca/8C9A-AEF4/core/run_multi_conv.py',
> wdir='/run/media/luca/8C9A-AEF4/core')
> Mapped name None to device cuda: Tesla K40c
> Using cuDNN version 5005 on context None
> /home/luca/data/Theano-master/theano/tensor/signal/downsample.py:6:
> UserWarning: downsample module has been moved to the
> theano.tensor.signal.pool module.
> "downsample module has been moved to the theano.tensor.signal.pool
> module.")
> Disabling C code for Elemwise{mul,no_inplace} due to unsupported float16
> Disabling C code for Elemwise{Cast{float32}} due to unsupported float16
> Disabling C code for Elemwise{Cast{float16}} due to unsupported float16
> Disabling C code for Elemwise{Cast{float16}} due to unsupported float16
> Disabling C code for Alloc due to unsupported float16
> Disabling C code for RandomFunction{binomial} due to unsupported float16
> Disabling C code for RandomFunction{binomial} due to unsupported float16
> Disabling C code for RandomFunction{binomial} due to unsupported float16
> Disabling C code for DiagonalSubtensor{inplace} due to unsupported float16
> Disabling C code for IncDiagonalSubtensor due to unsupported float16
> Disabling C code for RandomFunction{binomial} due to unsupported float16
> Disabling C code for RandomFunction{binomial} due to unsupported float16
> Disabling C code for RandomFunction{binomial} due to unsupported float16
> Disabling C code for DiagonalSubtensor{inplace} due to unsupported float16
> Disabling C code for MaxAndArgmax due to unsupported float16
>
>
> start time:
> 29/08/2016
> 11:30:44
>
>
> images for training: 574
> images for validation: 102
> epochs: 1000
>
>
> ... training neural network 33
>
>
> training @ iter = 0
> ------------------------
>
> USING FLOAT32
> .theanorc:
>
> [global]
> floatX = float32
> device = gpu
>
> [lib]
> cnmem=1
>
> [cuda]
> root = /usr/local/cuda-7.5
>
>
> [nvcc]
> fastmath=True
>
> optimizer = fast_compile
>
> output:
> Python 2.7.12 |Anaconda custom (64-bit)| (default, Jul 2 2016, 17:42:40)
> [GCC 4.4.7 20120313 (Red Hat 4.4.7-1)] on linux2
> Type "help", "copyright", "credits" or "license" for more information.
> Anaconda is brought to you by Continuum Analytics.
> Please check out: http://continuum.io/thanks and https://anaconda.org
> >>> runfile('/run/media/luca/8C9A-AEF4/core/run_multi_conv.py',
> wdir='/run/media/luca/8C9A-AEF4/core')
> Using gpu device 0: Tesla K40c (CNMeM is enabled with initial size: 95.0%
> of memory, cuDNN 5005)
> /home/luca/data/Theano-master/theano/tensor/signal/downsample.py:6:
> UserWarning: downsample module has been moved to the
> theano.tensor.signal.pool module.
> "downsample module has been moved to the theano.tensor.signal.pool
> module.")
>
>
> start time:
> 29/08/2016
> 11:32:43
>
>
> images for training: 574
> images for validation: 102
> epochs: 1000
>
>
> ... training neural network 33
>
>
> training @ iter = 0
>
>
>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "theano-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> For more options, visit https://groups.google.com/d/optout.
--
Pascal
--
---
You received this message because you are subscribed to the Google Groups
"theano-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
