[
https://issues.apache.org/jira/browse/MXNET-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913311#comment-16913311
]
Joseph Bethge commented on MXNET-1420:
--------------------------------------
I am interested in this and might just implement this myself. However I am just
now familiarizing myself with both the mxnet contribution procedure and the
paper, so it might take some time. If anyone wants to pick this up or
collaborate, let me know.
> Implement RAdam
> ---------------
>
> Key: MXNET-1420
> URL: https://issues.apache.org/jira/browse/MXNET-1420
> Project: Apache MXNet
> Issue Type: New Feature
> Components: Apache MXNet Backend, Gluon
> Reporter: Dheeraj M
> Priority: Major
>
> Implementation of RAdam optimizer based on the new paper [ON THE VARIANCE OF
> THE ADAPTIVE LEARNING RATE AND
> BEYOND|[https://arxiv.org/pdf/1908.03265v1.pdf]]
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
