Hi all, Just replied in other email about this situation, so yes for me is better at least return 1 when any test fails to make it backwards compatible and knows when some test fails.
Regards, Anibal On Mon, 26 Jul 2021 at 02:00, Tero Kinnunen <[email protected]> wrote: > I would favor to keep non-zero exit value if any tests failed. We have > relied on exit value since ptest started to support it, others may be doing > that as well. This would be backward incompatible change, making tests > silently fail. It is somewhat clumsy to try to parse failed tests from > output, so non-zero rc was very welcome change to me. > > Looking at other test runners, it is very common to return non-zero if any > tests failed. (Some examples: pytest, python unittest, googletest, shunit2, > robot framework.) See pytest exit codes for example: > https://docs.pytest.org/en/latest/reference/exit-codes.html > > Indeed the failed count is not a good exit value though because of > rollover, should be fixed. Could consider using own rc for "any tests > failed" differentiating from other errors. > > - Tero > > >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#54213): https://lists.yoctoproject.org/g/yocto/message/54213 Mute This Topic: https://lists.yoctoproject.org/mt/84352910/21656 Group Owner: [email protected] Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
