wenyangchu opened a new issue #11341: Deterministic cudnn algorithms
URL: https://github.com/apache/incubator-mxnet/issues/11341
 
 
   Hi all,
   
   I see other frameworks such as pytorch have some actions to have a flag to 
force cudnn to only use deterministic algorithm, specially for convolution and 
maxpooling:
   
   like in pytorch:
   [example](https://github.com/pytorch/pytorch/pull/2893/files)
   
   Some references to cudnn:
   
[maxpooling](https://docs.nvidia.com/deeplearning/sdk/cudnn-archived/cudnn_713/cudnn-developer-guide/index.html#cudnnPoolingMode_t
   )
   
[cudnnConvolutionBackwardData](https://docs.nvidia.com/deeplearning/sdk/cudnn-archived/cudnn_713/cudnn-developer-guide/index.html#cudnnConvolutionBackwardData)
   
   
[cudnnConvolutionBwdFilterAlgo_t](https://docs.nvidia.com/deeplearning/sdk/cudnn-archived/cudnn_713/cudnn-developer-guide/index.html#cudnnConvolutionBwdFilterAlgo_t)
   
   I am doing a medical product and reproducibility is an issue. Therefore, 
this feature will be very important for me.
   
   One solution is to have a flag like MXNET_CUDNN_AUTOTUNE_DEFAULT.
   Anyone is doing it? I have reviewed the current code and want to do it. 
   Any suggestion or better solution?
   
   Thanks
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to