siju-samuel commented on pull request #5887: URL: https://github.com/apache/incubator-tvm/pull/5887#issuecomment-647993442
Output mismatch between pytorch and tvm. Afer this PR ``` File "pytorch_pretrained_bert_uncased.py", line 112, in <module> tvm.testing.assert_allclose(torch_preds, compiled_output, rtol=1e-3, atol=1e-3) File "/home/siju/workspace/tvm/python/tvm/testing.py", line 36, in assert_allclose np.testing.assert_allclose(actual, desired, rtol=rtol, atol=atol, verbose=True) File "/home/siju/.local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1532, in assert_allclose assert_array_compare(compare, actual, desired, err_msg=str(err_msg), File "/home/siju/.local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 846, in assert_array_compare raise AssertionError(msg) AssertionError: Not equal to tolerance rtol=0.001, atol=0.001 Mismatched elements: 427297 / 427308 (100%) Max absolute difference: 24.692068 Max relative difference: 196537.89 x: array([[[ -7.879808, -7.787371, -7.786093, ..., -7.043789, -6.745376, -4.60134 ], [-13.363304, -13.769426, -13.781861, ..., -11.81282 ,... y: array([[[-0.419126, -0.420205, -0.41907 , ..., -0.789973, -0.782199, -0.496477], [-0.419126, -0.420205, -0.41907 , ..., -0.789973, -0.782199,... ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org