bgawrych commented on pull request #19308: URL: https://github.com/apache/incubator-mxnet/pull/19308#issuecomment-705359422
Hey @szha @samskalicky Do you know what's wrong with unix-gpu CI on 1.8 branch ? This test is not related to my change and it's failing ``` [2020-10-07T22:09:54.644Z] [2020-10-07T22:09:54.644Z] ====================================================================== [2020-10-07T22:09:54.644Z] FAIL: test_operator_gpu.test_np_mixed_precision_binary_funcs [2020-10-07T22:09:54.644Z] ---------------------------------------------------------------------- [2020-10-07T22:09:54.644Z] Traceback (most recent call last): [2020-10-07T22:09:54.644Z] File "/usr/local/lib/python3.5/dist-packages/nose/case.py", line 198, in runTest [2020-10-07T22:09:54.644Z] self.test(*self.arg) [2020-10-07T22:09:54.644Z] File "/usr/local/lib/python3.5/dist-packages/nose/util.py", line 620, in newfunc [2020-10-07T22:09:54.644Z] return func(*arg, **kw) [2020-10-07T22:09:54.644Z] File "/work/mxnet/tests/python/gpu/../unittest/common.py", line 218, in test_new [2020-10-07T22:09:54.644Z] orig_test(*args, **kwargs) [2020-10-07T22:09:54.644Z] File "/work/mxnet/python/mxnet/util.py", line 297, in _with_np_shape [2020-10-07T22:09:54.644Z] return func(*args, **kwargs) [2020-10-07T22:09:54.644Z] File "/work/mxnet/python/mxnet/util.py", line 481, in _with_np_array [2020-10-07T22:09:54.644Z] return func(*args, **kwargs) [2020-10-07T22:09:54.644Z] File "/work/mxnet/tests/python/gpu/../unittest/test_numpy_op.py", line 2607, in test_np_mixed_precision_binary_funcs [2020-10-07T22:09:54.644Z] check_mixed_precision_binary_func(func, low, high, lshape, rshape, lgrad, rgrad, type1, type2) [2020-10-07T22:09:54.644Z] File "/work/mxnet/tests/python/gpu/../unittest/test_numpy_op.py", line 2550, in check_mixed_precision_binary_func [2020-10-07T22:09:54.644Z] use_broadcast=False, equal_nan=True) [2020-10-07T22:09:54.644Z] File "/work/mxnet/python/mxnet/test_utils.py", line 749, in assert_almost_equal [2020-10-07T22:09:54.644Z] raise AssertionError(msg) [2020-10-07T22:09:54.644Z] AssertionError: [2020-10-07T22:09:54.644Z] Items are not equal: [2020-10-07T22:09:54.644Z] Error 1.732774 exceeds tolerance rtol=1.000000e-02, atol=1.000000e-03 (mismatch 16.666667%). [2020-10-07T22:09:54.644Z] Location of maximum error: (1, 1), a=0.00978292, b=0.01171875 [2020-10-07T22:09:54.644Z] ACTUAL: array([[0.77931417, 0.14845479, 0.22072042], [2020-10-07T22:09:54.644Z] [1.27150167, 0.00978292, 1.49220479]]) [2020-10-07T22:09:54.644Z] DESIRED: array([[0.78125 , 0.15039062, 0.22265625], [2020-10-07T22:09:54.644Z] [1.2734375 , 0.01171875, 1.49414062]]) [2020-10-07T22:09:54.645Z] -------------------- >> begin captured stdout << --------------------- [2020-10-07T22:09:54.645Z] [2020-10-07T22:09:54.645Z] *** Maximum errors for vector of size 6: rtol=0.01, atol=0.001 [2020-10-07T22:09:54.645Z] [2020-10-07T22:09:54.645Z] 1: Error 1.732774 Location of error: (1, 1), a=0.00978292, b=0.01171875 [2020-10-07T22:09:54.645Z] [2020-10-07T22:09:54.645Z] --------------------- >> end captured stdout << ---------------------- [2020-10-07T22:09:54.645Z] -------------------- >> begin captured logging << -------------------- [2020-10-07T22:09:54.645Z] common: WARNING: Error seen with seeded test, use MXNET_TEST_SEED=694743356 to reproduce. [2020-10-07T22:09:54.645Z] --------------------- >> end captured logging << --------------------- [2020-10-07T22:09:54.645Z] [2020-10-07T22:09:54.645Z] ---------------------------------------------------------------------- ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
