huifengguo commented on issue #17728: Poor performance when we use mx.symbol.Variable(..,..,stype="row-sparse") to define the variable URL: https://github.com/apache/incubator-mxnet/issues/17728#issuecomment-593172672 > what optimizer are you using? update rules for some optimizer with sparse grad maybe different: https://mxnet.apache.org/api/python/docs/api/optimizer/index.html#mxnet.optimizer.SGD The optimizer we are using is Adam, which is defined as: `optim = mx.optimizer.create(optimizer, learning_rate=lr,wd=1.0E-9, rescale_grad=1.0/batch_size,epsilon=5e-8)`
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
