rondogency commented on issue #18665: URL: https://github.com/apache/incubator-mxnet/issues/18665#issuecomment-654546346
can confirm currently MXNet doesn't support both update global running mean/var and use running mean/var to calculate grads in one pass of Batchnorm, while Keras-MXNet can support it by passing mean/var as arguments to Batchnorm as a workaround adding the support would still have constraints, especially cudnn doesn't support it so it cannot run with the best performance; some other frameworks like caffe doesn't support this either it can be implemented by modifying batch_norm.cc/cu and add "use_shift_scale" option to control it ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
