On Wed, 13 Jan 2010, Ludovic Courtès wrote:
> Hi,
>
> FWIW the test suite appears to pass on NixOS GNU/Linux (ÿÿmake testÿÿ
> returns 0), though I find the message misleading:
>
> --8<---------------cut here---------------start------------->8---
> --------------------------------
> total score
> --------------------------------
> good = 298/325
> Current score is equal to expected score; everything is fine
> --8<---------------cut here---------------end--------------->8---
>
> Does that mean that 298 tests passed and the 325 - 298 failed? If so I
> think it should exit with non-zero. A summary like ÿÿX tests run, Y
> passed, Z failedÿÿ would be clearer IMO.
This test suite is just really not meant for end-users. 325-298 failed,
but the fact that it says that everything is fine means that those tests
were not expected to pass either. Perhaps they test some feature that is
known not to be properly supported for example. We want the test to be
there for ourselves, so that we can remember to address the problem some
day, but when we make a change we want to know that all of the tests have
passed that are expected to pass.
julia
_______________________________________________
Cocci mailing list
[email protected]
http://lists.diku.dk/mailman/listinfo/cocci
(Web access from inside DIKUs LAN only)
