Lunderberg opened a new pull request, #16337:
URL: https://github.com/apache/tvm/pull/16337

   The `test_pass_fq2i_avg_pool2d.py::test_avgpool_conv2d` test is sensitive to 
rounding errors, and failed about a third of the time (42 / 100 tests).  This 
was first noticed as CI failures in unrelated PRs (e.g. 
https://ci.tlcpack.ai/blue/organizations/jenkins/tvm-hexagon/detail/PR-16184/6/tests).
 This commit marks the flaky portions of the test with `pytest.mark.xfail`, to 
avoid causing breaking CI for other PRs.
   
   To minimize the extent of the disabled test cases, this commit breaks up 
each of the unit tests.  Where previously a single test performed both 
hardware/simulation tests and relay graph comparisons, these are now done in 
separate test functions.  The hardware/simulation tests use 
`tvm.testing.assert_allclose` and have a tolerance of `1e-02`, while the 
graph-comparison tests use `tvm.ir.structural_equal`, and require identical 
floating-point values.  Only the graph-comparison test is disabled here.
   
   The other two test cases in `test_pass_fq2i_avg_pool2d.py` do not show this 
same sensitivity, with no failures seen in 100 executions.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to