anirudhacharya opened a new issue #13585: Exponential Moving Average/Polyak Averaging in MXNet URL: https://github.com/apache/incubator-mxnet/issues/13585 How can I implement Polyak averaging of as part of my network, in the wavenet model - https://arxiv.org/abs/1711.10433 I am not sure it can be implemented as an optimizer, it is more like a post-processing step on the weights after the optimizer update. Tensorflow has it here - https://www.tensorflow.org/api_docs/python/tf/train/ExponentialMovingAverage @ThomasDelteil
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
