Hi I published the slides I presented at the last MXNet meetup on automatic differentiation and higher order gradients. If you want to get more insights to understand some PRs which have been sent or future directions on this area for 2.0. I also compare implementation across major deep learning frameworks. Let me know if you have any questions or feedbacks and please click like or share my post.
https://www.linkedin.com/posts/pedrolarroy_the-essence-of-deep-learning-automatic-differentiation-activity-6613142805923536896-PuI5/ Pedro.