> Jos Boumans wrote: >> I got this bug report for CPANPLUS the other day, which turns out that >> Test.pm >> does not actually exit with a non-zero exitcode like Test::More does on >> failed tests: >> >> http://rt.cpan.org/Ticket/Display.html?id=22685 > > You're right, Test.pm does not, never has and does not have to. Exiting > non-zero on failure is a little "feature" I put in to make using > Test::More without Test::Harness a little easier but I plan on removing > it.
Hmm, I hope this doesn't mean you plan on removing the 'non-zero exit status on failed make test'.. that's be a real PITA for automated installers... >> This means neither CPAN.pm nor CPANPLUS actually detect the fact that a >> 'make test' failed. > > This is not Test.pm's fault but the fact that test.pl is not run through > Test::Harness by MakeMaker. This is a historical accident. No, I won't > change it. Many test.pl's do not output TAP. For example, DBI's test.pl > contains benchmarking code. > > Neither CPAN nor CPANPLUS are under any obligation to parse their output. > The solution is to get authors to stop using test.pl. It does of course generate questions when the human sees 'make test failed' on his screen and CPAN/CPANPLUS say 'make test passed, installing'. Is there anything we could use to DTRT thing here, or is it time for Yet Another Disclaimer? Thanks for shedding some light on the matter, Jos
