wkcn edited a comment on issue #18475: URL: https://github.com/apache/incubator-mxnet/issues/18475#issuecomment-639377361
I try to test the batch norm with `fix_gamma=True` on GPU, the test fails on `assert_almost_equal(bn_beta.grad.asnumpy(), db.asnumpy(), atol=atol, rtol=rtol)` in [test_operator.py#L1950](https://github.com/apache/incubator-mxnet/blob/master/tests/python/unittest/test_operator.py#L1950). ``` (<function BatchNorm at 0x7f54854753b0>, (24, 2), 0, False) (<function BatchNorm at 0x7f54854753b0>, (24, 2), 0, False) (<function BatchNorm at 0x7f54854753b0>, (24, 2), 0, True) (<function BatchNorm at 0x7f54854753b0>, (24, 2), 0, True) (<function BatchNorm at 0x7f54854753b0>, (24, 2), 1, False) *** Maximum errors for vector of size 2: rtol=0.01, atol=0.01 1: Error 90.669586 Location of error: (0,), a=28.82106400, b=14.64017868 2: Error 64.738541 Location of error: (1,), a=22.83149147, b=13.46625137 ``` However, the result on CPU is correct. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
