wkcn commented on issue #18751: URL: https://github.com/apache/incubator-mxnet/issues/18751#issuecomment-660600872
The values of moving_mean and moving_var are not consistent between CPU and GPU. The values on CPU is population variance (v / n), but that on GPU CUDNN is sample variance (v / (n - 1)). Refer: https://github.com/apache/incubator-mxnet/pull/18694/files#diff-cb652780258e73a9cd08568f38929aa2R1554 The line 1554 in tests/python/unittest/test_operator.py ```# cudnn uses m-1 in the denominator of its sample variance calculation, not m``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org