SINGA-192 Implement optimization algorithms for v1 Merge PR#164.
Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/272100a3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-singa/tree/272100a3 Diff: http://git-wip-us.apache.org/repos/asf/incubator-singa/diff/272100a3 Branch: refs/heads/master Commit: 272100a3ff81bb39aef0e9c5b483c0d5ed023e04 Parents: b167dfa 5784bff Author: Wei Wang <[email protected]> Authored: Mon Jun 13 17:54:48 2016 +0800 Committer: Wei Wang <[email protected]> Committed: Mon Jun 13 17:54:48 2016 +0800 ---------------------------------------------------------------------- include/singa/model/optimizer.h | 43 ++++++++++++++ src/core/tensor/math_kernel.cu | 14 ++--- src/core/tensor/math_kernel.h | 2 +- src/model/optimizer/adagrad.cc | 36 ++++++++++++ src/model/optimizer/nesterov.cc | 43 ++++++++++++++ src/model/optimizer/rmsprop.cc | 41 ++++++++++++++ test/singa/test_adagrad.cc | 96 +++++++++++++++++++++++++++++++ test/singa/test_nesterov.cc | 101 +++++++++++++++++++++++++++++++++ test/singa/test_rmsprop.cc | 106 +++++++++++++++++++++++++++++++++++ 9 files changed, 474 insertions(+), 8 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/272100a3/src/core/tensor/math_kernel.cu ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/272100a3/src/core/tensor/math_kernel.h ----------------------------------------------------------------------
