jeremiedb commented on issue #17207: LR schedulers do not work in R URL: https://github.com/apache/incubator-mxnet/issues/17207#issuecomment-577516261 @onomatet Glad that you found a viable turn around. I performed a test with a modified SGD and updater where the execs get rebuilt. On a CNN model on MNIST where the weights executors where updated 22 times during an epoch, training time went from 3.1 sec to 3.6 sec, so roughly 0.025 sec per learning rate update. From a sprase learning rate update perspective, it appears reasonable, but in scenarios where the lr is continuously adapted, then I doubt it's desirable. I'd be curious to get some feedback on whether it would be worth reworking the optimizers to integrate such mechanism.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
