haojin2 commented on issue #10227: Flaky test: test_operator.test_layer_norm URL: https://github.com/apache/incubator-mxnet/issues/10227#issuecomment-410074085 Happened again: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/PR-11986/2/pipeline ``` ====================================================================== FAIL: test_operator.test_layer_norm ---------------------------------------------------------------------- Traceback (most recent call last): File "C:\Anaconda3\envs\py2\lib\site-packages\nose\case.py", line 197, in runTest self.test(*self.arg) File "C:\jenkins_slave\workspace\ut-python-gpu\tests\python\unittest\test_operator.py", line 3147, in test_layer_norm forward_check_eps=forward_check_eps) File "C:\jenkins_slave\workspace\ut-python-gpu\tests\python\unittest\test_operator.py", line 3083, in check_layer_normalization numeric_eps=1e-2, rtol=1e-2, atol=1e-2) File "C:\jenkins_slave\workspace\ut-python-gpu\pkg_vc14_gpu\python\mxnet\test_utils.py", line 917, in check_numeric_gradient ("NUMERICAL_%s"%name, "BACKWARD_%s"%name)) File "C:\jenkins_slave\workspace\ut-python-gpu\pkg_vc14_gpu\python\mxnet\test_utils.py", line 493, in assert_almost_equal raise AssertionError(msg) AssertionError: Items are not equal: Error 1.031757 exceeds tolerance rtol=0.010000, atol=0.010000. Location of maximum error:(4, 2, 0), a=0.016902, b=0.027503 NUMERICAL_data: array([[[-0.83571225, -0.39195567, -0.65418553, -0.39927065, -0.25080964], [ 0.68750679, 0.03032088, 0.02044216, -0.84786415, -0.23824871], [-0.61543953, -0.70688128, -0.02324693, -0.69272518, -0.51978898],... BACKWARD_data: array([[[-0.83574855, -0.39192304, -0.65416901, -0.39928018, -0.25077481], [ 0.68751844, 0.03033861, 0.02035761, -0.84786007, -0.23824724], [-0.6154799 , -0.70687513, -0.02326486, -0.6927109 , -0.51977907],... ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
