[
https://issues.apache.org/jira/browse/SINGA-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15166761#comment-15166761
]
ASF subversion and git services commented on SINGA-145:
-------------------------------------------------------
Commit ec0878bad4c5e6f1e92b10b601705de96f1d2e39 in incubator-singa's branch
refs/heads/master from [~jinyang]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=ec0878b ]
SINGA-145 New SGD based optimization Updaters: AdaDelta, Adam, Adammax
--------
clean job.conf
> New SGD based optimization Updaters: AdaDelta, Adam, AdamMax
> ------------------------------------------------------------
>
> Key: SINGA-145
> URL: https://issues.apache.org/jira/browse/SINGA-145
> Project: Singa
> Issue Type: New Feature
> Environment: Universal
> Reporter: Wang Ji
> Priority: Minor
>
> This ticket implements three Stochastic Gradient Descent (SGD) based
> optimization algorithms in Updater.cc, i.e. AdaDelta, Adaptive Moment
> Estimation(Adam) with its variant AdamMax .These algorithms adapt the
> learning rate to the parameters, performing larger updates for infrequent and
> smaller updates for frequent parameters.
> For algorithm details, refer to AdaDelata (http://arxiv.org/abs/1212.5701),
> Adam (http://arxiv.org/pdf/1412.6980.pdf).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
