# from Ovid
# on Sunday 02 December 2007 07:47:

>--- nadim khemir <[EMAIL PROTECTED]> wrote:
>> The subject says it all. IE:
...
>> t/20_policies.t               15    2  578 583
>
>It just means "you need to investigate this further".  Personally, I
>would like to see it optionally mean failure,...

How is "extra credit" *ever* any sort of failure?

It does mean "the tests need to be adjusted", and maybe "the report 
should contain more info than just a boolean 'true'."

But it should definitely not even be an option to report it as a 
failure.

In an automated publishing tool, I would treat it as non-shippable by 
default but have an option to ship it anyway.  For instance:  a tricky 
cross-platform bug might fail on machines that the author doesn't have.

In nightly smoke reports, you might have the "everything's ok" set to 
silent, but would want to send mail when TODO()s pass.

Perhaps that means prove's return code is non-zero, or that the $answer 
ne "Result: PASS\n", but only if those are treated as "not failure".  
YAML?

--Eric
-- 
"Beware of bugs in the above code; I have only proved it correct, not
tried it."
--Donald Knuth
---------------------------------------------------
    http://scratchcomputing.com
---------------------------------------------------

Reply via email to