Wang Ji created SINGA-123:
-----------------------------
Summary: Add RMSProp method for Updater
Key: SINGA-123
URL: https://issues.apache.org/jira/browse/SINGA-123
Project: Singa
Issue Type: New Feature
Reporter: Wang Ji
Priority: Minor
RMSProp
[tieleman2012rmsprop](http://www.cs.toronto.edu/~tijmen/csc321/slides/lecture_slides_lec6.pdf)
is an optimizer that utilizes the magnitude of recent gradients to normalize
the gradients.
This ticket adds some codes in updater.cc to implement this optimizing method.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
