Hi, I just published a new plugin to hadle flaky tests:
https://pypi.python.org/pypi/pytest-ignore-flaky https://github.com/schettino72/pytest-ignore-flaky feedback welcome cheers, Eduardo pytest-ignore-flaky ==================== ignore failures from flaky tests (pytest plugin) A "flaky" test is a test that usually pass but sometimes it fails. You should always avoid flaky tests but not always possible. This plugin can be used to optionally ignore failures from flaky tests. First "mark" your tests with the `flaky` marker:: import random import pytest @pytest.mark.flaky def test_mf(): assert 0 == random.randint(0, 1) By default this mark is just ignored, unless the plugin is activated from the command line (or `py.test` config file):: py.test --ignore-flaky If a flaky test pass it will be reported normally as test succeed. If the test fails, instead of being reported as failure it will be reported as a `xfail`.
_______________________________________________ pytest-dev mailing list [email protected] https://mail.python.org/mailman/listinfo/pytest-dev
