orhankislal opened a new pull request #564: URL: https://github.com/apache/madlib/pull/564
JIRA: MADLIB-1434, MADLIB-1435 This commit adds two new variants on the gradient descent algorithms. They are paried together since they both involve adaptive learning rates. rmsprop: Keep a moving average of the squared gradient for each weight Adam: Keep an exponential moving average of the gradient and the squared gradient <!-- Thanks for sending a pull request! Here are some tips for you: 1. Refer to this link for contribution guidelines https://cwiki.apache.org/confluence/display/MADLIB/Contribution+Guidelines 2. Please Provide the Module Name, a JIRA Number and a short description about your changes. --> - [ ] Add the module name, JIRA# to PR/commit and description. - [ ] Add tests for the change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
