Xue Wanqi created SINGA-387:
-------------------------------
Summary: Modified the design of autograd backward engine and
correct some mistakes in it
Key: SINGA-387
URL: https://issues.apache.org/jira/browse/SINGA-387
Project: Singa
Issue Type: Improvement
Reporter: Xue Wanqi
Old design of autograd engine will return intermediate gradients. We should
avoid the happen of that. For the parameters(tensors) need to store gradients,
they or their creator should know whether the gradients are calculated readily.
and only when gradients are prepared then they can be output.
Old design of autograd engine will store some unused gradient in dictionary
not_ready. this should be avoid as well in the new design.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
