zixuanweeei commented on issue #15464: MKL-DNN gives wrong convolution bias 
gradient if weights gradient is not requested
URL: 
https://github.com/apache/incubator-mxnet/issues/15464#issuecomment-508634883
 
 
   @matteosal I think this is perhaps caused by the fact that the forward 
convolution operator supports calculation either with or without bias. And both 
cases require weights in the convolutional operator. So in the backward 
process, the gradient of bias could be either calculated or not. This leads to 
only two backward APIs supported by MKL-DNN corresponding to the cases of the 
forward operations. Actually, we can just take the gradients of the weights 
away. And we have located the problem. Further verification is required before 
taking a PR.
   BTW, could you provide some examples that only requires the gradients of 
bias? We will very appreciate it. Thanks. 😃 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to