jeremiedb commented on issue #17207: LR schedulers do not work in R URL: https://github.com/apache/incubator-mxnet/issues/17207#issuecomment-577001401 At the moment, I can't think of a quick turnaround for fixing that LR update issue. Having a condition to rebuild the weights executors seems to be a viable route to take, at least from an initial PoC on SGD. A concern is whether rebuilding execs might cause some memory overhead on large models. It remains to be validated, but if it's safe to assume learning rate update would typically be use only a limited number of times during training, it should be ok. I expect to be able to submit a proposal by next week.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
