[incubator-mxnet] branch master updated: set _scale in Trainer using optimizer rescale_grad (#14593)

[haibin]

This is an automated email from the ASF dual-hosted git repository.

haibin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git


The following commit(s) were added to refs/heads/master by this push:
     new 53743d6  set _scale in Trainer using optimizer rescale_grad (#14593)
53743d6 is described below

commit 53743d6adbbc419016b1077fe13bb5a2a9f31a90
Author: Yuxi Hu <darreny...@gmail.com>
AuthorDate: Wed Apr 3 11:30:30 2019 -0700

    set _scale in Trainer using optimizer rescale_grad (#14593)
---
 python/mxnet/gluon/trainer.py | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/python/mxnet/gluon/trainer.py b/python/mxnet/gluon/trainer.py
index 45a44d8..a95417c 100644
--- a/python/mxnet/gluon/trainer.py
+++ b/python/mxnet/gluon/trainer.py
@@ -95,10 +95,10 @@ class Trainer(object):
             if param._grad_stype != 'default':
                 self._contains_sparse_grad = True
         self._compression_params = compression_params
-        optimizer_params = optimizer_params if optimizer_params else {}
-        self._scale = float(optimizer_params.get('rescale_grad', 1.0))
         self._contexts = self._check_contexts()
+        optimizer_params = optimizer_params if optimizer_params else {}
         self._init_optimizer(optimizer, optimizer_params)
+        self._scale = self._optimizer.rescale_grad
         self._kvstore_params = {'kvstore': kvstore, 'update_on_kvstore': 
update_on_kvstore}
         self._kv_initialized = False
         self._kvstore = None