huifengguo removed a comment on issue #17728: Poor performance when we use mx.symbol.Variable(..,..,stype="row-sparse") to define the variable URL: https://github.com/apache/incubator-mxnet/issues/17728#issuecomment-596374312 > Yes, there's no free food. You can still "use Adam and row_sparse variable" with `lazy_update=False` to get identical update, the only benefit you get is less that data is transmitted during communication OK，we just notice another setting in optimizer, namely whether we set the kvstore when initializing the optimizer. ``` optim = mx.optimizer.create(optimizer, learning_rate=lr, rescale_grad=1.0/batch_size, lazy_update=False) mod.init_optimizer(kvstore=store, optimizer=optim) ``` Then, to verity why the loss of accuracy comes from, we conduct the following experimets. There are 3 parameters we can set, so there are 8 different settings.  As the results show, the performance is bad when we choose kvstore and adopt row_sparse variable. Is there anything wrong? Waiting for your reply.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
