wangwei created SINGA-129:
-----------------------------
Summary: Add new SGD updaters
Key: SINGA-129
URL: https://issues.apache.org/jira/browse/SINGA-129
Project: Singa
Issue Type: New Feature
Reporter: wangwei
Assignee: Jinyang Gao
Currently, some basic SGD updaters have been implemented in SINGA, including,
SGDUpdater AdaGradUpdater and NesterovUpdater.
RMSPropUpdater will be added in SINGA-123.
This ticket is going to implement some other common updaters, e.g., AdaDelata
(http://arxiv.org/abs/1212.5701), Adam (http://arxiv.org/pdf/1412.6980.pdf) .
ActiveSampler (http://arxiv.org/abs/1512.03880) could be implemented together
with this ticket or using a new ticket.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
