anirudhacharya edited a comment on issue #11865: attach_grad of intermediate variables causes the gradient graph to be lost URL: https://github.com/apache/incubator-mxnet/issues/11865#issuecomment-488478932 > It will probably involve storing intermediate gradients of non-leaf variables in some sort of a buffer by providing a hook/function call to the user to enable storing the gradients of non-leaf variables because storing it every time by default might be a waste of memory. @szha would you agree with the above part that these intermediate gradients should not be stored by default but rather we should provide a function call, something like `persist_grad` which the user can call along with the variables( like `x.persist_grad()`) to enable storing of intermediate gradients?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
