[
https://issues.apache.org/jira/browse/SINGA-387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16582209#comment-16582209
]
ASF subversion and git services commented on SINGA-387:
-------------------------------------------------------
Commit 770d6cdb65ae528cfc9cae6e357198648c088168 in incubator-singa's branch
refs/heads/master from xuewanqi
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=770d6cd ]
SINGA-387 Modified the design of autograd backward engine and correct some
mistakes in it
- test the modified engine by running example networks in /example/autograd
folder and fix some bugs. all files can run without error.
> Modified the design of autograd backward engine and correct some mistakes in
> it
> -------------------------------------------------------------------------------
>
> Key: SINGA-387
> URL: https://issues.apache.org/jira/browse/SINGA-387
> Project: Singa
> Issue Type: Improvement
> Reporter: Xue Wanqi
> Priority: Major
>
> Old design of autograd engine will return intermediate gradients. We should
> avoid the happen of that. For the parameters(tensors) need to store
> gradients, they or their creator should know whether the gradients are
> calculated readily. and only when gradients are prepared then they can be
> output.
> Old design of autograd engine will store some unused gradient in dictionary
> not_ready. this should be avoid as well in the new design.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
