ptrendx opened a new pull request #18905: URL: https://github.com/apache/incubator-mxnet/pull/18905
## Description ## cuDNN expects bias stride to be (C, 1, C, C), whereas currently it is provided by MXNet as (C, 1, 1, 1). This PR also changes the order of calls to wgrad and bgrad. This has potential to boost performance, because wgrad uses the same data as bgrad, but is typically compute-limited (so the data transfer cost is hidden), so there is a chance that the data needed by purely BW-bound bgrad is already in cache.. @DickJC123 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
