Vikas89 commented on issue #14029: Out of memory error in 3d Conv for matrix splits > 10, CUDNN strange behaviour URL: https://github.com/apache/incubator-mxnet/issues/14029#issuecomment-459040588 This looks like cuDNN implementation bug, Looks like different code inside cudnn is being called for cases > 10 This is for case 11, void fft3d_r2c_16x16x16 is called , for case 10 or less : void cudnn::detail::implicit_convolveNd_sgemm is called. We verified that disabling cuDNN during convolution fixes the problem. @ptrendx @DickJC123 Would you guys be able to help here in case you have any idea about this behavior of cuDNN or if you can point this to right people.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
