Hey all,

There's a nasty (IMHO) bug in the jUnit plugin that allows it to completely 
ignore tests in the XML provided to it, which in the worst case means a 
test that failed might be ignored and a green build will result. In the 
best case, it results in a fluctuating number of tests and missed results. 
It also happens with xUnit, I assume because of the same underlying bug.

The basic idea of https://issues.jenkins-ci.org/browse/JENKINS-28490 is 
that if certain <testsuite> attributes are the same, such as timestamp, 
Jenkins only picks up on the first one, and ignores other test classes that 
have the same timestamp. So if multiple XML files have the same timestamp, 
Jenkins ignores all but the first! It has been reproduced in recent Jenkins 
/ jUnit versions, and has steps and example XML files that reproduce the 
problem.

Any help would be appreciated; I may be biased, it just seems quite nasty 
that a CI server can totally ignore tests this unexpectedly and silently, 
so I wanted to raise it :)

- Mike

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-dev/ae52e4e5-e0b4-478f-b7d5-f1e52fa76f08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to