szhengac opened a new issue #17666: flaky test: 
test_operator.test_gru_bidirectional on unix cpu
URL: https://github.com/apache/incubator-mxnet/issues/17666
 
 
   [2020-02-23T23:25:41.378Z] FAIL: test_operator.test_gru_bidirectional
   
   [2020-02-23T23:25:41.378Z] 
----------------------------------------------------------------------
   
   [2020-02-23T23:25:41.378Z] Traceback (most recent call last):
   
   [2020-02-23T23:25:41.378Z]   File 
"/usr/local/lib/python3.5/dist-packages/nose/case.py", line 198, in runTest
   
   [2020-02-23T23:25:41.378Z]     self.test(*self.arg)
   
   [2020-02-23T23:25:41.378Z]   File 
"/work/mxnet/tests/python/unittest/common.py", line 215, in test_new
   
   [2020-02-23T23:25:41.378Z]     orig_test(*args, **kwargs)
   
   [2020-02-23T23:25:41.378Z]   File 
"/work/mxnet/tests/python/unittest/common.py", line 132, in test_new
   
   [2020-02-23T23:25:41.378Z]     orig_test(*args, **kwargs)
   
   [2020-02-23T23:25:41.378Z]   File 
"/work/mxnet/tests/python/unittest/test_operator.py", line 203, in 
test_gru_bidirectional
   
   [2020-02-23T23:25:41.378Z]     check_rnn_consistency(fused, stack, T, N, I, 
H, 'add')
   
   [2020-02-23T23:25:41.378Z]   File 
"/work/mxnet/tests/python/unittest/test_operator.py", line 61, in 
check_rnn_consistency
   
   [2020-02-23T23:25:41.378Z]     
assert_allclose(mod1.get_outputs()[0].asnumpy(), 
mod2.get_outputs()[0].asnumpy(), rtol=rtol, atol=atol)
   
   [2020-02-23T23:25:41.378Z]   File "/work/mxnet/python/mxnet/test_utils.py", 
line 641, in assert_allclose
   
   [2020-02-23T23:25:41.378Z]     assert_almost_equal(a, b, rtol=rtol, 
atol=atol, equal_nan=equal_nan)
   
   [2020-02-23T23:25:41.378Z]   File "/work/mxnet/python/mxnet/test_utils.py", 
line 637, in assert_almost_equal
   
   [2020-02-23T23:25:41.378Z]     raise AssertionError(msg)
   
   [2020-02-23T23:25:41.378Z] AssertionError: 
   
   [2020-02-23T23:25:41.378Z] Items are not equal:
   
   [2020-02-23T23:25:41.378Z] Error 1.922186 exceeds tolerance 
rtol=1.000000e-02, atol=1.000000e-04 (mismatch 0.068359%).
   
   [2020-02-23T23:25:41.378Z] Location of maximum error: (11, 4, 63), 
a=-0.00064722, b=-0.00085589
   
   [2020-02-23T23:25:41.378Z]  ACTUAL: array([[[-0.00117005,  0.00022226,  
0.00137723, ...,  0.00076188,
   
   [2020-02-23T23:25:41.378Z]           0.00022805, -0.00078047],
   
   [2020-02-23T23:25:41.378Z]         [-0.00225882,  0.00044489,  0.00184364, 
...,  0.00129345,...
   
   [2020-02-23T23:25:41.378Z]  DESIRED: array([[[-0.00117005,  0.00022226,  
0.00137723, ...,  0.00076193,
   
   [2020-02-23T23:25:41.378Z]           0.00022808, -0.00078048],
   
   [2020-02-23T23:25:41.378Z]         [-0.00225882,  0.00044489,  0.00184364, 
...,  0.00129353,...
   
   [2020-02-23T23:25:41.378Z] -------------------- >> begin captured stdout << 
---------------------
   
   [2020-02-23T23:25:41.378Z] 
   
   [2020-02-23T23:25:41.378Z] *** Maximum errors for vector of size 10240:  
rtol=0.01, atol=0.0001
   
   [2020-02-23T23:25:41.378Z] 
   
   [2020-02-23T23:25:41.378Z]   1: Error 1.922186  Location of error: (11, 4, 
63), a=-0.00064722, b=-0.00085589
   
   [2020-02-23T23:25:41.378Z]   2: Error 1.384701  Location of error: (21, 4, 
63), a=-0.00065550, b=-0.00080512
   
   [2020-02-23T23:25:41.378Z]   3: Error 1.288360  Location of error: (12, 4, 
63), a=-0.00059031, b=-0.00072853
   
   [2020-02-23T23:25:41.378Z]   4: Error 1.160074  Location of error: (2, 4, 
47), a=-0.00055688, b=-0.00068078
   
   [2020-02-23T23:25:41.378Z]   5: Error 1.155231  Location of error: (6, 4, 
47), a=-0.00026074, b=-0.00038066
   
   [2020-02-23T23:25:41.378Z]   6: Error 1.110948  Location of error: (17, 4, 
63), a=-0.00075886, b=-0.00087973
   
   [2020-02-23T23:25:41.378Z]   7: Error 1.020427  Location of error: (19, 4, 
63), a=-0.00074288, b=-0.00085364

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to