Am 02.09.2022 um 03:38 schrieb Julius Werner:
Right now, when you have a CL that builds fine but fails unit tests,
Jenkins with Verified -1 it with a failure page like this
https://qa.coreboot.org/job/coreboot-gerrit/215770/ , which just says
"Test Result (no failures)". If you know your way around Jenkins you
can click on the "Console Output" link on the left and scroll down to
see the actual unit test errors, but most people who see this for the
first time will probably be very confused and have a hard chance
finding that on their own.

This isn't "the unit test fails", it's "the unit test failed to compile".

Is there any way we could make that more obvious and display the unit
tests as a real element among the test results (or at least put some
sort of "click Console Output to see errors" message on there)?
Unfortunately I have no idea how anything on that page is configured
or generated -- Patrick or Martin, I hope one of you guys would know
more?

We'd have to wrap the build process for the unit tests to report into junit on error.

tests/Makefile.inc already looks for JUNIT_OUTPUT. The target in tests/Makefile.common for $($(1)-bin) would have to be extended to create a report on build failure.

The junit.xml target in payloads/libpayload/Makefile.inc might serve as inspiration.


Patrick
_______________________________________________
coreboot mailing list -- coreboot@coreboot.org
To unsubscribe send an email to coreboot-le...@coreboot.org

Reply via email to