larroy commented on issue #15120: [bug] fix higher grad log 
URL: https://github.com/apache/incubator-mxnet/pull/15120#issuecomment-498870894
 
 
   Hi @kshitij12345 thanks for looking into this.
   
   I think we need to clarify what exactly we have in the first parameter of 
FGradient "node". We were a bit puzzled with @apeforest looking at your PR. I 
validated the results with the tests but I think I tried only one log, don't 
remember which base. But the result seemed correct to me, I guess I missed this 
problem.
   
   Why do you say that node is ograd*f'(x)?     the node argument I understand 
is the node to calculate the gradient for, in this case we are calculating the 
gradient of the backward of the log. So are you saying that by chain rule, the 
node is ograd(of log) * d (log(x)) / dx  = ograd * reciprocal?
   
   Would be great if we could add this to the documentation, either to the 
FGradient typedef or to new_op. Otherwise I always have to dig through the code 
to refresh this. I think is poorly documented and tricky.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to