Hi all,
Below my signoff is a snippet from a test program ...
You'll note that the one program has over 6,000 tests, but that's
because they're aggregated. We now print out an ok/not ok status for
each aggregated test program, but with so many aggregated tests, we
need a summary. In effect, I've been asked to replicate a bit of our
test harness output inside of Test::Aggregate. In short, we need
nested TAP.
Is there any chance we can produce something viable in Oslo that's
likely to solve this problem or is this a low enough priority in most
people's minds that they're not bothered? I'm keenly focused on
managing large-scale test suites and need stuff like this.
Cheers,
Ovid
t/aggregate......7/?
# Failed test 'aggtests/rest/xmlschema/brand/valid/basic.xml is not
valid'
# at
/home/lindsj05/source/pips3/branches/on_air_ids/t/lib//TestFIPSchema.pm
line 67.
# $VAR1 = 'Expecting element ids, got master_brand
# Element brand failed to validate content
# ';
# Failed test 'aggtests/rest/xmlschema/brand/valid/promotions.xml is
not valid'
# at
/home/lindsj05/source/pips3/branches/on_air_ids/t/lib//TestFIPSchema.pm
line 67.
# $VAR1 = 'Expecting element ids, got master_brand
# Element brand failed to validate content
# ';
# not ok - aggtests/rest/xmlschema/brand.t
*** CUT FOR YOUR PLEASURE ***
t/aggregate......6181/? # ok - aggtests/unit/schema/revision_info.t
# ok - aggtests/unit/schema/schema.t
# ok - aggtests/unit/schema/schemabase.t
t/aggregate......6208/? # ok - aggtests/unit/schema/series.t
# ok - aggtests/unit/schema/version/basic.t
# Looks like you failed 12 tests of 6227.
t/aggregate...... Dubious, test returned 12 (wstat 3072, 0xc00)
Failed 12/6227 subtests
(less 2 skipped subtests: 6213 okay)
Test Summary Report
-------------------
t/aggregate.t (Wstat: 3072 Tests: 6227 Failed: 12)
Failed tests: 7-8, 14-15, 24-25, 29-30, 32-35
Non-zero exit status: 12
Files=1, Tests=6227, 300 wallclock secs ( 1.36 usr 0.13 sys + 200.61
cusr 8.57 csys = 210.67 CPU)
Result: FAIL
--
Buy the book - http://www.oreilly.com/catalog/perlhks/
Perl and CGI - http://users.easystreet.com/ovid/cgi_course/
Personal blog - http://publius-ovidius.livejournal.com/
Tech blog - http://use.perl.org/~Ovid/journal/
