@szha: I do agree in general. But with cuDNN, you sometimes want to disable it only for specific layers. For example, we disable cuDNN for batchnorm layers when `eps < 10^-5`, as cuDNN fails in this case (and sometimes you import nets from other frameworks with smaller values for `eps` that you want to run). You definitely don't want a global variable switching off cuDNN for all layers in the net.
[ Full content available at: https://github.com/apache/incubator-mxnet/pull/12691 ] This message was relayed via gitbox.apache.org for devnull@infra.apache.org