That Theano flag don't work well. Don't use it. The only save way is to have only one of the cuda version in your environment variable. This what we do here.
You can use shell string manipulation to remove the version define by default and replace it with the other version. Fred Le 30 sept. 2016 03:54, "David Menéndez Hurtado" <[email protected]> a écrit : > Hi, > > I want to run Theano on top of Cuda 8 while keeping Cuda 7.5 as the > default for other applications. > > If I set /usr/local/cuda to point at /usr/local/cuda-8.0 and set cuda.root > to /usr/local/cuda in .theanorc, everything works well; but if that points > to cuda-7.5 and I explicitely set .theanorc to use cuda-8.0, I get the > error at the end. > > My guess is that either Theano is picking some of the enviroment > variables, like LD_LIBRARY_PATH or CUDA_TOOLKIT_PATH, and I have to set > them manually; or it is not finding the right gcc (in cuda8-0/bin/gcc) and > it is using system's one. Any idea on how can I fix it? > > > Thank you. > > =============================== > In file included from mod.cu:4:0: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > theano/sandbox/cuda/cuda_ndarray.cuh:17:0: warning: "PyString_Check" > redefined > #define PyString_Check PyUnicode_Check > ^ > In file included from /home/david/.virtualenvs/py35/ > lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0, > from mod.cu:4: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > numpy/core/include/numpy/npy_3kcompat.h:63:0: note: this is the location > of the previous definition > #define PyString_Check PyBytes_Check > ^ > In file included from mod.cu:4:0: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > theano/sandbox/cuda/cuda_ndarray.cuh:18:0: warning: "PyString_FromString" > redefined > #define PyString_FromString PyUnicode_FromString > ^ > In file included from /home/david/.virtualenvs/py35/ > lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0, > from mod.cu:4: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > numpy/core/include/numpy/npy_3kcompat.h:65:0: note: this is the location > of the previous definition > #define PyString_FromString PyBytes_FromString > ^ > In file included from mod.cu:4:0: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > theano/sandbox/cuda/cuda_ndarray.cuh:19:0: warning: "PyString_AsString" > redefined > #define PyString_AsString PyUnicode_AsUTF8 > ^ > In file included from /home/david/.virtualenvs/py35/ > lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0, > from mod.cu:4: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > numpy/core/include/numpy/npy_3kcompat.h:72:0: note: this is the location > of the previous definition > #define PyString_AsString PyBytes_AsString > ^ > In file included from mod.cu:4:0: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > theano/sandbox/cuda/cuda_ndarray.cuh:20:0: warning: > "PyString_FromStringAndSize" redefined > #define PyString_FromStringAndSize PyUnicode_FromStringAndSize > ^ > In file included from /home/david/.virtualenvs/py35/ > lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0, > from mod.cu:4: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > numpy/core/include/numpy/npy_3kcompat.h:66:0: note: this is the location > of the previous definition > #define PyString_FromStringAndSize PyBytes_FromStringAndSize > ^ > In file included from mod.cu:4:0: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > theano/sandbox/cuda/cuda_ndarray.cuh:21:0: warning: "PyString_Size" > redefined > #define PyString_Size PyUnicode_GET_SIZE > ^ > In file included from /home/david/.virtualenvs/py35/ > lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0, > from mod.cu:4: > /home/david/.virtualenvs/py35/lib/python3.5/site-packages/ > numpy/core/include/numpy/npy_3kcompat.h:74:0: note: this is the location > of the previous definition > #define PyString_Size PyBytes_Size > ^ > /usr/local/cuda-8.0/include/surface_functions.h(134): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(135): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(136): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(137): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(138): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(139): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(140): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(141): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(142): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(143): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(144): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(145): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(146): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(147): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(148): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(149): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(150): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(151): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(152): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(153): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(154): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(155): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(156): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(157): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(158): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(159): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(160): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(161): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(162): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(163): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(164): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(228): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(229): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(230): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(231): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(294): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(295): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(296): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(297): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(298): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(299): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(300): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(301): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(302): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(303): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(304): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(305): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(306): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(307): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(308): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(309): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(310): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(311): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(312): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(313): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(314): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(315): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(316): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(317): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(318): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(319): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(320): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(321): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(322): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(323): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(324): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(390): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(391): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(392): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(393): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(456): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(457): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(458): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(459): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(460): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(461): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(462): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(463): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(464): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(465): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(466): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(467): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(468): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(469): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(470): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(471): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(472): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(473): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(474): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(475): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(476): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(477): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(478): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(479): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(480): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(481): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(482): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(483): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(484): error: expected a > ";" > /usr/local/cuda-8.0/include/surface_functions.h(485): error: expected a > ";" > Error limit reached. > 100 errors detected in the compilation of "/tmp/tmpxft_000012b9_ > 00000000-9_mod.cpp1.ii". > Compilation terminated. > > ['nvcc', '-shared', '-O3', '-arch=sm_50', '-m64', '-Xcompiler', > '-fno-math-errno,-Wno-unused-label,-Wno-unused-variable,- > Wno-write-strings,-DCUDA_NDARRAY_CUH=mc72d035fdf91890f3b36710688069 > b2e,-DNPY_NO_DEPRECATED_API=NPY_1_7_API_VERSION,-fPIC,-fvisibility=hidden', > '-Xlinker', '-rpath,/home/david/.theano/compiledir_Linux-4.7-fc24.x86_ > 64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray', > '-I/home/david/.theano/compiledir_Linux-4.7-fc24.x86_ > 64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray', > '-I/usr/local/cuda-8.0/include', '-I/home/david/.virtualenvs/ > py35/lib/python3.5/site-packages/numpy/core/include', > '-I/usr/include/python3.5m', '-I/home/david/.virtualenvs/ > py35/lib/python3.5/site-packages/theano/gof', '-I/home/david/.virtualenvs/ > py35/lib/python3.5/site-packages/theano/sandbox/cuda', > '-L/home/david/.theano/compiledir_Linux-4.7-fc24.x86_ > 64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray', > '-L/usr/lib64', '-o', '/home/david/.theano/compiledir_Linux-4.7-fc24.x86_ > 64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/tmp180rca2o/ > m28488bfe450723ef20f18edd8e611eb0.so', 'mod.cu', '-lcudart', '-lcublas', > '-lcuda_ndarray', '-lpython3.5m'] > Traceback (most recent call last): > File "<string>", line 1, in <module> > File > "/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/__init__.py", > line 118, in <module> > theano.sandbox.cuda.tests.test_driver.test_nvidia_driver1() > File "/home/david/.virtualenvs/py35/lib/python3.5/site- > packages/theano/sandbox/cuda/tests/test_driver.py", line 32, in > test_nvidia_driver1 > profile=False) > File "/home/david/.virtualenvs/py35/lib/python3.5/site- > packages/theano/compile/function.py", line 326, in function > output_keys=output_keys) > File "/home/david/.virtualenvs/py35/lib/python3.5/site- > packages/theano/compile/pfunc.py", line 484, in pfunc > output_keys=output_keys) > File "/home/david/.virtualenvs/py35/lib/python3.5/site- > packages/theano/compile/function_module.py", line 1789, in orig_function > defaults) > File "/home/david/.virtualenvs/py35/lib/python3.5/site- > packages/theano/compile/function_module.py", line 1653, in create > input_storage=input_storage_lists, storage_map=storage_map) > File > "/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/link.py", > line 699, in make_thunk > storage_map=storage_map)[:3] > File > "/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/vm.py", > line 1051, in make_all > no_recycling)) > File "/home/david/.virtualenvs/py35/lib/python3.5/site- > packages/theano/sandbox/cuda/__init__.py", line 257, in make_thunk > compute_map, no_recycling) > File > "/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/op.py", > line 932, in make_thunk > no_recycling) > File > "/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/op.py", > line 833, in make_c_thunk > output_storage=node_output_storage) > File > "/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/cc.py", > line 1190, in make_thunk > keep_lock=keep_lock) > File > "/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/cc.py", > line 1131, in __compile__ > keep_lock=keep_lock) > File > "/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/cc.py", > line 1589, in cthunk_factory > key=key, lnk=self, keep_lock=keep_lock) > File "/home/david/.virtualenvs/py35/lib/python3.5/site- > packages/theano/gof/cmodule.py", line 1145, in module_from_key > module = lnk.compile_cmodule(location) > File > "/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/cc.py", > line 1492, in compile_cmodule > preargs=preargs) > File "/home/david/.virtualenvs/py35/lib/python3.5/site- > packages/theano/sandbox/cuda/nvcc_compiler.py", line 405, in compile_str > 'for cmd', ' '.join(cmd)) > Exception: ('The following error happened while compiling the node', > GpuCAReduce{add}{1}(<CudaNdarrayType(float32, vector)>), '\n', 'nvcc > return status', 4, 'for cmd', 'nvcc -shared -O3 -arch=sm_50 -m64 -Xcompiler > -fno-math-errno,-Wno-unused-label,-Wno-unused-variable,- > Wno-write-strings,-DCUDA_NDARRAY_CUH=mc72d035fdf91890f3b36710688069 > b2e,-DNPY_NO_DEPRECATED_API=NPY_1_7_API_VERSION,-fPIC,-fvisibility=hidden > -Xlinker -rpath,/home/david/.theano/compiledir_Linux-4.7-fc24.x86_ > 64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray > -I/home/david/.theano/compiledir_Linux-4.7-fc24.x86_ > 64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray > -I/usr/local/cuda-8.0/include -I/home/david/.virtualenvs/ > py35/lib/python3.5/site-packages/numpy/core/include > -I/usr/include/python3.5m -I/home/david/.virtualenvs/ > py35/lib/python3.5/site-packages/theano/gof -I/home/david/.virtualenvs/ > py35/lib/python3.5/site-packages/theano/sandbox/cuda > -L/home/david/.theano/compiledir_Linux-4.7-fc24.x86_ > 64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray > -L/usr/lib64 -o /home/david/.theano/compiledir_Linux-4.7-fc24.x86_ > 64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/tmp180rca2o/ > m28488bfe450723ef20f18edd8e611eb0.so mod.cu -lcudart -lcublas > -lcuda_ndarray -lpython3.5m', '[GpuCAReduce{add}{1}(<CudaNdarrayType(float32, > vector)>)]') > > > -- > > --- > You received this message because you are subscribed to the Google Groups > "theano-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- --- You received this message because you are subscribed to the Google Groups "theano-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
