larroy commented on issue #11973: control flow operator tests failing on Linux 
and Windows
URL: 
https://github.com/apache/incubator-mxnet/issues/11973#issuecomment-409914267
 
 
   Tested on a clean repo, got the failure again.
   
   tvm @ commit 290226e1c9adbb3e598f9ed9184018df1c12be33
   Author: Jian Weng <[email protected]>
   Date:   Fri Jun 22 13:47:45 2018 -0700
   
       [FRONTEND] A Python hybrid frontend (#1251)
   
   
   ```
   (mxnet_py3) piotr@oruga:0:~/tmp/mxnet/tests/python/unittest (master)+$ 
nosetests test_contrib_control_flow.py 
   .[INFO] Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=1683218039 to reproduce.
   F.[INFO] Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=941599958 to reproduce.
   F[INFO] Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=240299619 to reproduce.
   F[INFO] Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=1598500162 to reproduce.
   F[INFO] Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=1409147838 to reproduce.
   F.[INFO] Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=2084233205 to reproduce.
   F
   ======================================================================
   FAIL: test_contrib_control_flow.test_while_loop_for_foreach
   ----------------------------------------------------------------------
   Traceback (most recent call last):
     File 
"/home/piotr/tmp/mxnet/mxnet_py3/lib/python3.5/site-packages/nose/case.py", 
line 198, in runTest
       self.test(*self.arg)
     File "/home/piotr/tmp/mxnet/tests/python/unittest/common.py", line 172, in 
test_new
       orig_test(*args, **kwargs)
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 618, in test_while_loop_for_foreach
       n_steps=5,
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 322, in case_1
       **params
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 240, in _verify_while_loop
       assert_almost_equal(imp_out, sym_out, rtol=1e-4, atol=1e-4)
     File "/home/piotr/tmp/mxnet/python/mxnet/test_utils.py", line 493, in 
assert_almost_equal
       raise AssertionError(msg)
   AssertionError: 
   Items are not equal:
   Error 9419.442383 exceeds tolerance rtol=0.000100, atol=0.000100.  Location 
of maximum error:(3, 0), a=-278.021240, b=-4805.078613
    a: array([[   7.8534303],
          [ -21.46705  ],
          [  81.15463  ],...
    b: array([[  122.632 ],
          [ -384.9325],
          [ 1387.7172],...
   -------------------- >> begin captured logging << --------------------
   common: INFO: Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=1683218039 to reproduce.
   --------------------- >> end captured logging << ---------------------
   
   ======================================================================
   FAIL: test_contrib_control_flow.test_while_loop_rnn
   ----------------------------------------------------------------------
   Traceback (most recent call last):
     File 
"/home/piotr/tmp/mxnet/mxnet_py3/lib/python3.5/site-packages/nose/case.py", 
line 198, in runTest
       self.test(*self.arg)
     File "/home/piotr/tmp/mxnet/tests/python/unittest/common.py", line 172, in 
test_new
       orig_test(*args, **kwargs)
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 969, in test_while_loop_rnn
       assert_almost_equal(x, y, rtol=1e-4, atol=1e-4)
     File "/home/piotr/tmp/mxnet/python/mxnet/test_utils.py", line 493, in 
assert_almost_equal
       raise AssertionError(msg)
   AssertionError: 
   Items are not equal:
   Error 1192.026733 exceeds tolerance rtol=0.000100, atol=0.000100.  Location 
of maximum error:(2, 0, 0), a=-0.761594, b=-1.000000
    a: array([[[-0.9640275 ,  0.00000083, -0.9615498 ],
           [-0.99496937,  0.00000054, -0.96949065]],
   ...
    b: array([[[-0.9999996 ,  0.00000125, -0.9999996 ],
           [-0.9999996 ,  0.00000131, -0.99998957]],
   ...
   -------------------- >> begin captured logging << --------------------
   common: INFO: Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=941599958 to reproduce.
   --------------------- >> end captured logging << ---------------------
   
   ======================================================================
   FAIL: test_contrib_control_flow.test_cond
   ----------------------------------------------------------------------
   Traceback (most recent call last):
     File 
"/home/piotr/tmp/mxnet/mxnet_py3/lib/python3.5/site-packages/nose/case.py", 
line 198, in runTest
       self.test(*self.arg)
     File "/home/piotr/tmp/mxnet/tests/python/unittest/common.py", line 172, in 
test_new
       orig_test(*args, **kwargs)
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 1129, in test_cond
       (2, 3),
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 1087, in run_case
       **params
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 1056, in _verify_cond
       assert_almost_equal(imp_out, sym_out, rtol=1e-5, atol=1e-5)
     File "/home/piotr/tmp/mxnet/python/mxnet/test_utils.py", line 493, in 
assert_almost_equal
       raise AssertionError(msg)
   AssertionError: 
   Items are not equal:
   Error 36462.175781 exceeds tolerance rtol=0.000010, atol=0.000010.  Location 
of maximum error:(1, 1), a=-0.928016, b=-2.034438
    a: array([[-1.4817346 , -0.76791453, -0.26404768],
          [-0.22492273, -0.92801595, -0.4418202 ]], dtype=float32)
    b: array([[-1.4817346 , -0.76791453, -0.26404768],
          [-0.22492273, -2.0344381 , -0.4418202 ]], dtype=float32)
   -------------------- >> begin captured logging << --------------------
   common: INFO: Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=240299619 to reproduce.
   --------------------- >> end captured logging << ---------------------
   
   ======================================================================
   FAIL: test_contrib_control_flow.test_contrib_rnn
   ----------------------------------------------------------------------
   Traceback (most recent call last):
     File 
"/home/piotr/tmp/mxnet/mxnet_py3/lib/python3.5/site-packages/nose/case.py", 
line 198, in runTest
       self.test(*self.arg)
     File "/home/piotr/tmp/mxnet/tests/python/unittest/common.py", line 172, in 
test_new
       orig_test(*args, **kwargs)
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 1193, in test_contrib_rnn
       check_contrib_rnn(cell_type, num_states)
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 1177, in check_contrib_rnn
       assert_almost_equal(res1.asnumpy(), res2.asnumpy(), rtol=0.001, 
atol=0.0001)
     File "/home/piotr/tmp/mxnet/python/mxnet/test_utils.py", line 493, in 
assert_almost_equal
       raise AssertionError(msg)
   AssertionError: 
   Items are not equal:
   Error 5951.356934 exceeds tolerance rtol=0.001000, atol=0.000100.  Location 
of maximum error:(3, 6, 25), a=0.627485, b=-0.006533
    a: array([[[ 0.00909132, -0.26697633,  0.07916373, ...,  0.31235063,
            -0.15670209, -0.4814965 ],
           [ 0.68945557,  0.31152144, -0.1506751 , ...,  0.06814943,...
    b: array([[[-0.16027294, -0.97353685, -0.99997824, ...,  0.99858755,
            -1.        , -1.        ],
           [ 1.        ,  1.        ,  0.9863122 , ...,  0.9025492 ,...
   -------------------- >> begin captured logging << --------------------
   common: INFO: Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=1598500162 to reproduce.
   --------------------- >> end captured logging << ---------------------
   
   ======================================================================
   FAIL: test_contrib_control_flow.test_foreach
   ----------------------------------------------------------------------
   Traceback (most recent call last):
     File 
"/home/piotr/tmp/mxnet/mxnet_py3/lib/python3.5/site-packages/nose/case.py", 
line 198, in runTest
       self.test(*self.arg)
     File "/home/piotr/tmp/mxnet/tests/python/unittest/common.py", line 172, in 
test_new
       orig_test(*args, **kwargs)
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 1324, in test_foreach
       lambda frees : [frees[0] + frees[1]])
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 1297, in verify_foreach
       rtol=0.001, atol=0.0001)
     File "/home/piotr/tmp/mxnet/python/mxnet/test_utils.py", line 493, in 
assert_almost_equal
       raise AssertionError(msg)
   AssertionError: 
   Items are not equal:
   Error 11016.041992 exceeds tolerance rtol=0.001000, atol=0.000100.  Location 
of maximum error:(2, 1), a=674.000000, b=56.000000
    a: array([[  2.,  22.],
          [ 24., 216.],
          [ 90., 674.]], dtype=float32)
    b: array([[ 2., 12.],
          [12., 30.],
          [30., 56.]], dtype=float32)
   -------------------- >> begin captured logging << --------------------
   common: INFO: Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=1409147838 to reproduce.
   --------------------- >> end captured logging << ---------------------
   
   ======================================================================
   FAIL: test_contrib_control_flow.test_foreach_rnn
   ----------------------------------------------------------------------
   Traceback (most recent call last):
     File 
"/home/piotr/tmp/mxnet/mxnet_py3/lib/python3.5/site-packages/nose/case.py", 
line 198, in runTest
       self.test(*self.arg)
     File "/home/piotr/tmp/mxnet/tests/python/unittest/common.py", line 172, in 
test_new
       orig_test(*args, **kwargs)
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 1664, in test_foreach_rnn
       check_foreach_rnn(cell_type, num_states)
     File 
"/home/piotr/tmp/mxnet/tests/python/unittest/test_contrib_control_flow.py", 
line 1652, in check_foreach_rnn
       rtol=0.001, atol=0.0001)
     File "/home/piotr/tmp/mxnet/python/mxnet/test_utils.py", line 493, in 
assert_almost_equal
       raise AssertionError(msg)
   AssertionError: 
   Items are not equal:
   Error 190.672119 exceeds tolerance rtol=0.001000, atol=0.000100.  Location 
of maximum error:(0, 1, 0), a=0.790261, b=1.000000
    a: array([[[0.93483055, 0.95413005, 0.9039076 , 0.8553966 ],
           [0.7902607 , 0.8560267 , 0.89933217, 0.92859614]],
   ...
    b: array([[[1., 1., 1., 1.],
           [1., 1., 1., 1.]],
   ...
   -------------------- >> begin captured logging << --------------------
   common: INFO: Setting test np/mx/python random seeds, use 
MXNET_TEST_SEED=2084233205 to reproduce.
   --------------------- >> end captured logging << ---------------------
   
   ----------------------------------------------------------------------
   Ran 9 tests in 6.138s
   
   FAILED (failures=6)
   (mxnet_py3) piotr@oruga:1:~/tmp/mxnet/tests/python/unittest (master)+$ 
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to