On Jul 2, 2014, at 11:40 PM, Narayan Balasubramanian (நாராயண் ) <bv.nara...@gmail.com> wrote:
> Hi: > > I ran the CoAdvisor (http://coad.measurement-factory.com) compliance tests > against 4.2.2 and 5.0 > > I ran with 5.0 changed settings as well as default settings. > > 5.0 new settings are described at: > https://cwiki.apache.org/confluence/display/TS/What%27s+new+in+v5.0.x#What'snewinv5.0.x-Changeddefaultconfigurations > > Here is a summary of the results: > > In version 5.0, 441/718 test cases passed - 61% pass > In version 4.2, 472/718 test cases passed - 66% pass > In version 5.0 with 4.2 setting 471/718 test cases passed - 66% pass > In version 4.2 with 5.0 setting, 441/718 test cases passed - 61% pass Very cool! I think having a Wiki page with these results (and future runs) would be very useful. Just a brief summary on each release, with the counts on passes / violations / failures would be cool. Even cooler would be to go back to at least v4.0.0, maybe every 3.2.5, and then go forward? Thoughts? — Leif