Re: How to distinct errors and failures in tests

2021-04-21 Thread nikola...@gmail.com
Thank you for the answer. If I don't mistake, JUnit plugin just publishes the report, but unittest can't produce JUint-compatible xml. Anyway, we agree to consider builds with failed tests like failed. Tests generate some artifacts, and I want to know all artifacts exist before trying to

How to distinct errors and failures in tests

2021-04-21 Thread Nick N
Hey, guys! I have a freestyle project. It builds an app and run tests (python, unittest). It is quite straightforward if return codes are 0 then build is successful, otherwise it is failed. Earlier I returned amount of errors and failures as a returncode to see tests results on the dashboard

Re: How to distinct errors and failures in tests

2021-04-21 Thread Ullrich Hafner
Typically you do not set the status of a build by setting the return code. Your build should never alter the return code just because the tests are failing. So I would suggest that your build always returns 0 if the build is successful (ignoring the test results). The JUnit plugin will do the

ANN - DevOps World 2021 CFP is Open

2021-04-21 Thread Alyssa Tong
Hi all, DevOps World 2021 is now accepting speaking proposals, and will end on May 20. The conference will be virtual on Sept 28 - 30. Jenkins plans to have workshops, Ask the Experts, contributor summit at this event. More details to come as we get closer to