sxjscience commented on issue #10002: General support of OPs for second-order 
gradient
URL: 
https://github.com/apache/incubator-mxnet/issues/10002#issuecomment-370957305
 
 
   @aidan-plenert-macdonald I suggest we should first classify the OPs into 
three categories.
   - [ ] OPs that we can directly register their backward_ops to be some 
specific forward OPs, e.g, all element-wise operators + reduce/broadcasting 
operators, dot/batch_dot, ....  Most OPs in the [tensor 
folder](https://github.com/apache/incubator-mxnet/tree/master/src/operator/tensor)
 should satisfy this criteria.
   - [ ] OPs that may need more investigation in how to register the backward, 
e.g, most OPs in the [nn 
folder](https://github.com/apache/incubator-mxnet/tree/master/src/operator/nn) 
including Convolution/Deconvolution/Pooling, etc.
   - [ ] Some other corner cases like OPs in the [contrib 
folder](https://github.com/apache/incubator-mxnet/tree/master/src/operator/contrib)
 and [random 
folder](https://github.com/apache/incubator-mxnet/tree/master/src/operator/random)

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to