SayHiRay commented on issue #17855: TensorRT does not work on other GPUs except GPU0 URL: https://github.com/apache/incubator-mxnet/issues/17855#issuecomment-604412875 > It seems the onnx-trt not setting the device properly. @SayHiRay If you accept a dirty workaround try replace ctx = mx.gpu(1) with these: > > ```python > from ctypes import cdll, c_char_p > libcudart = cdll.LoadLibrary('libcudart.so') > libcudart.cudaGetErrorString.restype = c_char_p > def cudaSetDevice(device_idx): > ret = libcudart.cudaSetDevice(device_idx) > if ret != 0: > error_string = libcudart.cudaGetErrorString(ret) > raise RuntimeError("cudaSetDevice: " + error_string) > > device_id = 1 > cudaSetDevice(device_id) > ctx = mx.gpu(device_id) > ``` @TristonC Thanks for the workaround. It works great!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
