marcoabreu edited a comment on issue #11747: Flaky test test_quantization_mkldnn.test_requantize_int32_to_int8 URL: https://github.com/apache/incubator-mxnet/issues/11747#issuecomment-408899929 Hi, please run the following commands: 1. ``ci/build.py -p ubuntu_cpu -i`` 2. ``PYTHONPATH=/work/mxnet/python python3 tools/flakiness_checker.py -s 2127644814 test_quantization_mkldnn.test_requantize_int32_to_int8`` The output will be: ```PYTHONPATH=/work/mxnet/python python3 tools/flakiness_checker.py -n 10000 test_quantization_mkldnn.test_requantize_int32_to_int8 INFO:root:Testing: /work/mxnet/tests/python/mkl/test_quantization_mkldnn.py:test_requantize_int32_to_int8 INFO:root:No test seed provided, using random seed test_quantization_mkldnn.test_requantize_int32_to_int8 ... [INFO] 351 of 10000: Setting test np/mx/python random seeds, use MXNET_TEST_SEED=2127644814 to reproduce. FAIL ====================================================================== FAIL: test_quantization_mkldnn.test_requantize_int32_to_int8 ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.5/dist-packages/nose/case.py", line 198, in runTest self.test(*self.arg) File "/usr/local/lib/python3.5/dist-packages/nose/util.py", line 620, in newfunc return func(*arg, **kw) File "/work/mxnet/tests/python/mkl/../quantization/common.py", line 172, in test_new orig_test(*args, **kwargs) File "/work/mxnet/tests/python/mkl/../quantization/test_quantization.py", line 127, in test_requantize_int32_to_int8 check_requantize((3, 4, 10, 10)) File "/work/mxnet/tests/python/mkl/../quantization/test_quantization.py", line 123, in check_requantize assert_almost_equal(qdata_int8.asnumpy(), qdata_int8_np) File "/work/mxnet/python/mxnet/test_utils.py", line 493, in assert_almost_equal raise AssertionError(msg) AssertionError: Items are not equal: Error 1562.500000 exceeds tolerance rtol=0.000010, atol=0.000000. Location of maximum error:(1, 3, 1, 7), a=-63.000000, b=-64.000000 a: array([[[[-119, 61, -58, ..., 8, 123, 10], [ 97, 79, 11, ..., 37, -106, -13], [ 82, 53, -125, ..., 104, 90, 112],... b: array([[[[-119, 61, -58, ..., 8, 123, 10], [ 97, 79, 11, ..., 37, -106, -13], [ 82, 53, -125, ..., 104, 90, 112],... -------------------- >> begin captured logging << -------------------- common: INFO: 351 of 10000: Setting test np/mx/python random seeds, use MXNET_TEST_SEED=2127644814 to reproduce. --------------------- >> end captured logging << --------------------- ``` This output is entirely deterministic given the seed. For reference, I'm running on a g3.8xlarge. @pengzhao-intel @xinyu-intel
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
