Serhiy Storchaka <storchaka+cpyt...@gmail.com> added the comment:
PR 28082 is a draft that implements this idea. Skipped and failed (but not successfully passed) subtests are now reported separately, as a character (sFE) or a line ("skipped", "FAIL", "ERROR"). The description of the subtest is included in the line. For example: $ tests=.sFE ./python test_issue25894.py sFE ====================================================================== ERROR: test_subTest (__main__.TestClass) [3] (t='E') ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/serhiy/py/cpython/test_issue25894.py", line 15, in test_subTest raise Exception('error') ^^^^^^^^^^^^^^^^^^^^^^^^ Exception: error ====================================================================== FAIL: test_subTest (__main__.TestClass) [2] (t='F') ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/serhiy/py/cpython/test_issue25894.py", line 13, in test_subTest self.fail('failed') ^^^^^^^^^^^^^^^^^^^ AssertionError: failed ---------------------------------------------------------------------- Ran 1 test in 0.001s FAILED (failures=1, errors=1, skipped=1) $ tests=.sFE ./python test_issue25894.py -v test_subTest (__main__.TestClass) ... test_subTest (__main__.TestClass) [1] (t='s') ... skipped 'skipped' test_subTest (__main__.TestClass) [2] (t='F') ... FAIL test_subTest (__main__.TestClass) [3] (t='E') ... ERROR ====================================================================== ERROR: test_subTest (__main__.TestClass) [3] (t='E') ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/serhiy/py/cpython/test_issue25894.py", line 15, in test_subTest raise Exception('error') ^^^^^^^^^^^^^^^^^^^^^^^^ Exception: error ====================================================================== FAIL: test_subTest (__main__.TestClass) [2] (t='F') ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/serhiy/py/cpython/test_issue25894.py", line 13, in test_subTest self.fail('failed') ^^^^^^^^^^^^^^^^^^^ AssertionError: failed ---------------------------------------------------------------------- Ran 1 test in 0.001s FAILED (failures=1, errors=1, skipped=1) As a side effect, the test description is also repeated for every error in the test cleanup code (in tearDown() and doCleanup()). Similar changes should be added also in RegressionTestResult. If apply issue45057 first they will be much simpler. Issue29152 can be related. If call addError() and addFailure() from addSubTest(), PR 28082 should be rewritten. ---------- _______________________________________ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue25894> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com