apeforest commented on issue #14619: [Discussion] 1.5.0 Roadmap
URL: 
https://github.com/apache/incubator-mxnet/issues/14619#issuecomment-503645009
 
 
   @mouryarishik We've already have a few operators to support higher order 
gradient:
   
   ```
   elemwise_mul, log, log10, relu, FullyConnected, sin, cos, exp
   ```
   However, due to the current design of NNVM, the graph data structure to 
model the computation graph, the support of higher order gradient in operators 
has to be implemented one by one (good news is that moving to NNVM 2.0 in the 
near future higher order gradient in operators will be supported automatically 
by NNVM).
   
   In the meantime before NNVM is upgraded to 2.0, we plan to support higher 
order gradient in a limited number of operators. It would be great if you could 
identify a set of operators that are used in your model and require higher 
order gradient support. We will prioritize implementation for those operators.
   
   Thanks for your continuous support and passion for MXNet.
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to