Hi,
I want to run Theano on top of Cuda 8 while keeping Cuda 7.5 as the default
for other applications.
If I set /usr/local/cuda to point at /usr/local/cuda-8.0 and set cuda.root
to /usr/local/cuda in .theanorc, everything works well; but if that points
to cuda-7.5 and I explicitely set .theanorc to use cuda-8.0, I get the
error at the end.
My guess is that either Theano is picking some of the enviroment variables,
like LD_LIBRARY_PATH or CUDA_TOOLKIT_PATH, and I have to set them manually;
or it is not finding the right gcc (in cuda8-0/bin/gcc) and it is using
system's one. Any idea on how can I fix it?
Thank you.
===============================
In file included from mod.cu:4:0:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:17:0:
warning: "PyString_Check" redefined
#define PyString_Check PyUnicode_Check
^
In file included from
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0,
from mod.cu:4:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/numpy/core/include/numpy/npy_3kcompat.h:63:0:
note: this is the location of the previous definition
#define PyString_Check PyBytes_Check
^
In file included from mod.cu:4:0:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:18:0:
warning: "PyString_FromString" redefined
#define PyString_FromString PyUnicode_FromString
^
In file included from
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0,
from mod.cu:4:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/numpy/core/include/numpy/npy_3kcompat.h:65:0:
note: this is the location of the previous definition
#define PyString_FromString PyBytes_FromString
^
In file included from mod.cu:4:0:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:19:0:
warning: "PyString_AsString" redefined
#define PyString_AsString PyUnicode_AsUTF8
^
In file included from
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0,
from mod.cu:4:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/numpy/core/include/numpy/npy_3kcompat.h:72:0:
note: this is the location of the previous definition
#define PyString_AsString PyBytes_AsString
^
In file included from mod.cu:4:0:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:20:0:
warning: "PyString_FromStringAndSize" redefined
#define PyString_FromStringAndSize PyUnicode_FromStringAndSize
^
In file included from
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0,
from mod.cu:4:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/numpy/core/include/numpy/npy_3kcompat.h:66:0:
note: this is the location of the previous definition
#define PyString_FromStringAndSize PyBytes_FromStringAndSize
^
In file included from mod.cu:4:0:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:21:0:
warning: "PyString_Size" redefined
#define PyString_Size PyUnicode_GET_SIZE
^
In file included from
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/cuda_ndarray.cuh:11:0,
from mod.cu:4:
/home/david/.virtualenvs/py35/lib/python3.5/site-packages/numpy/core/include/numpy/npy_3kcompat.h:74:0:
note: this is the location of the previous definition
#define PyString_Size PyBytes_Size
^
/usr/local/cuda-8.0/include/surface_functions.h(134): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(135): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(136): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(137): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(138): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(139): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(140): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(141): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(142): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(143): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(144): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(145): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(146): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(147): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(148): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(149): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(150): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(151): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(152): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(153): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(154): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(155): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(156): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(157): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(158): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(159): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(160): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(161): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(162): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(163): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(164): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(228): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(229): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(230): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(231): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(294): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(295): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(296): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(297): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(298): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(299): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(300): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(301): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(302): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(303): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(304): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(305): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(306): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(307): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(308): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(309): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(310): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(311): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(312): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(313): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(314): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(315): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(316): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(317): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(318): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(319): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(320): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(321): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(322): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(323): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(324): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(390): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(391): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(392): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(393): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(456): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(457): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(458): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(459): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(460): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(461): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(462): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(463): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(464): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(465): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(466): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(467): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(468): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(469): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(470): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(471): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(472): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(473): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(474): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(475): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(476): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(477): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(478): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(479): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(480): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(481): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(482): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(483): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(484): error: expected a ";"
/usr/local/cuda-8.0/include/surface_functions.h(485): error: expected a ";"
Error limit reached.
100 errors detected in the compilation of
"/tmp/tmpxft_000012b9_00000000-9_mod.cpp1.ii".
Compilation terminated.
['nvcc', '-shared', '-O3', '-arch=sm_50', '-m64', '-Xcompiler',
'-fno-math-errno,-Wno-unused-label,-Wno-unused-variable,-Wno-write-strings,-DCUDA_NDARRAY_CUH=mc72d035fdf91890f3b36710688069b2e,-DNPY_NO_DEPRECATED_API=NPY_1_7_API_VERSION,-fPIC,-fvisibility=hidden',
'-Xlinker',
'-rpath,/home/david/.theano/compiledir_Linux-4.7-fc24.x86_64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray',
'-I/home/david/.theano/compiledir_Linux-4.7-fc24.x86_64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray',
'-I/usr/local/cuda-8.0/include',
'-I/home/david/.virtualenvs/py35/lib/python3.5/site-packages/numpy/core/include',
'-I/usr/include/python3.5m',
'-I/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof',
'-I/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda',
'-L/home/david/.theano/compiledir_Linux-4.7-fc24.x86_64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray',
'-L/usr/lib64', '-o',
'/home/david/.theano/compiledir_Linux-4.7-fc24.x86_64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/tmp180rca2o/m28488bfe450723ef20f18edd8e611eb0.so',
'mod.cu', '-lcudart', '-lcublas', '-lcuda_ndarray', '-lpython3.5m']
Traceback (most recent call last):
File "<string>", line 1, in <module>
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/__init__.py",
line 118, in <module>
theano.sandbox.cuda.tests.test_driver.test_nvidia_driver1()
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/tests/test_driver.py",
line 32, in test_nvidia_driver1
profile=False)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/compile/function.py",
line 326, in function
output_keys=output_keys)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/compile/pfunc.py",
line 484, in pfunc
output_keys=output_keys)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/compile/function_module.py",
line 1789, in orig_function
defaults)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/compile/function_module.py",
line 1653, in create
input_storage=input_storage_lists, storage_map=storage_map)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/link.py",
line 699, in make_thunk
storage_map=storage_map)[:3]
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/vm.py",
line 1051, in make_all
no_recycling))
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/__init__.py",
line 257, in make_thunk
compute_map, no_recycling)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/op.py",
line 932, in make_thunk
no_recycling)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/op.py",
line 833, in make_c_thunk
output_storage=node_output_storage)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/cc.py",
line 1190, in make_thunk
keep_lock=keep_lock)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/cc.py",
line 1131, in __compile__
keep_lock=keep_lock)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/cc.py",
line 1589, in cthunk_factory
key=key, lnk=self, keep_lock=keep_lock)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/cmodule.py",
line 1145, in module_from_key
module = lnk.compile_cmodule(location)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof/cc.py",
line 1492, in compile_cmodule
preargs=preargs)
File
"/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda/nvcc_compiler.py",
line 405, in compile_str
'for cmd', ' '.join(cmd))
Exception: ('The following error happened while compiling the node',
GpuCAReduce{add}{1}(<CudaNdarrayType(float32, vector)>), '\n', 'nvcc return
status', 4, 'for cmd', 'nvcc -shared -O3 -arch=sm_50 -m64 -Xcompiler
-fno-math-errno,-Wno-unused-label,-Wno-unused-variable,-Wno-write-strings,-DCUDA_NDARRAY_CUH=mc72d035fdf91890f3b36710688069b2e,-DNPY_NO_DEPRECATED_API=NPY_1_7_API_VERSION,-fPIC,-fvisibility=hidden
-Xlinker
-rpath,/home/david/.theano/compiledir_Linux-4.7-fc24.x86_64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray
-I/home/david/.theano/compiledir_Linux-4.7-fc24.x86_64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray
-I/usr/local/cuda-8.0/include
-I/home/david/.virtualenvs/py35/lib/python3.5/site-packages/numpy/core/include
-I/usr/include/python3.5m
-I/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/gof
-I/home/david/.virtualenvs/py35/lib/python3.5/site-packages/theano/sandbox/cuda
-L/home/david/.theano/compiledir_Linux-4.7-fc24.x86_64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/cuda_ndarray
-L/usr/lib64 -o
/home/david/.theano/compiledir_Linux-4.7-fc24.x86_64-x86_64-with-fedora-24-Twenty_Four-x86_64-3.5.1-64/tmp180rca2o/m28488bfe450723ef20f18edd8e611eb0.so
mod.cu -lcudart -lcublas -lcuda_ndarray -lpython3.5m',
'[GpuCAReduce{add}{1}(<CudaNdarrayType(float32, vector)>)]')
--
---
You received this message because you are subscribed to the Google Groups
"theano-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.