On Tue, Sep 16, 2008 at 12:27 PM, via RT Moritz Lenz <[EMAIL PROTECTED]> wrote: > # New Ticket Created by Moritz Lenz > # Please include the string: [perl #58934] > # in the subject line of all future correspondence about this issue. > # <URL: http://rt.perl.org/rt3/Ticket/Display.html?id=58934 > > > > 'make fulltest' runs several chunks of tests, and does not show a final > summary. So although some tests in some chunks fail, the last thing that > the tester sees is something along these lines: > > ===( 35 > )==========================================================All tests > successful. > Files=10, Tests=108, 29 wallclock secs ( 0.04 usr 0.02 sys + 19.55 cusr > 1.44 csys = 21.05 CPU) > Result: PASS > make[1]: Leaving directory `/home/moritz/src/parrot' > > If only the last chunk succeeded. > > This is very misleading, and probably dangerous. > > At the very least it should say something like "WARNING: not all tests > were successful, scroll up to find out which failed". > This could be done by collecting the return values from the various > 'make test*' calls. > > Even better would be real summary at the end listing the failed tests. > > (Observed with perl-5.10.0 and Test::Harness 3.11, parrot as of > shortly-before 0.7.1) > > Moritz > -- > Moritz Lenz > http://moritz.faui2k3.org/ | http://perl-6.de/ >
parrot's fulltest runs the harness multiple times without a very clear distinction. as i understand, this behavior can now be changed, as we require T::H 3. the fulltest target must be modified to report the results from each harness run together at the end, rather than seperately after each harness run. ~jerry
