FYI: I've made some improvements to my Jenkins Test reports recently...
http://fucit.org/solr-jenkins-reports/
Most significantly: I've added a new summary report called "Suspicious
Test Failure Rate"...
http://fucit.org/solr-jenkins-reports/suspicious-failure-report.html
This summarizes the "Recent" failure rate data (past 7 days,
rolling) as compared to the "Historic" failure rate data
(previous 3 calendar weeks) along with the "Delta" (Recent Rate -
Historic Rage) for any test where the Delta is positive (ie: the "Recent"
failure rate is higher then the "Historic" rate)
Less interesting is that I cleaned up some of the data processing, so
test methods that report themselves with paramaterized names (ie: using
@Repeat, or @ParametersFactory) are now aggregated correctly -- this
will make the (Suspicious) Failure Rate reports more accurate/useful to be
to judge how often a give method is failure compared to other methods. I
did this about a week ago, so the data is already cleaner -- but for
things like the new Suspicious Test Failure Rate report it will take
another ~2weeks for the "Historic" values to be reliable.
(I also tried to "fix" the suite failure rate reporting, but ultimately
this is just not possible because of the limitations in how the
Jenkins/JUnit report formats thigns -- see the README.txt if you're
curious)
https://github.com/hossman/jenkins-reports/
-Hoss
http://www.lucidworks.com/
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
