Re: Test::Harness 3.10 lots of issues under Devel::Cover 0.64
These appear to all being due to the fact that Test::Harness does some very
specific tests of @INC and the environment which Devel::Cover changes. It's
not Devel::Cover's fault.
The below appear to be because Devel::Cover inserts its own blib into @INC and
the tests aren't wired to deal with that.
t/compat/inc-propagation..
# Failed test '@INC propagated to test'
# at inc_check_taint.t.tmp line 38.
# Structures begin differing at:
# $got-[0] =
'/home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch'
# $expected-[0] = 'wibble'
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/lib,
# wibble,
# t/lib,
# blib/lib,
# blib/arch,
# /home/gabor/perl5lib/lib/i486-linux-gnu-thread-multi,
# /home/gabor/perl5lib/lib,
# /home/gabor/perl5lib/lib/perl/5.8.8,
# /etc/perl,
# /usr/local/lib/perl/5.8.8,
# /usr/local/share/perl/5.8.8,
# /usr/lib/perl5,
# /usr/share/perl5,
# /usr/lib/perl/5.8,
# /usr/share/perl/5.8,
# /usr/local/lib/site_perl
# -
# wibble,
# t/lib,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/lib,
# blib/lib,
# blib/arch,
# /home/gabor/perl5lib/lib/i486-linux-gnu-thread-multi,
# /home/gabor/perl5lib/lib,
# /home/gabor/perl5lib/lib/perl/5.8.8,
# /etc/perl,
# /usr/local/lib/perl/5.8.8,
# /usr/local/share/perl/5.8.8,
# /usr/lib/perl5,
# /usr/share/perl5,
# /usr/lib/perl/5.8,
# /usr/share/perl/5.8,
# /usr/local/lib/site_perl
# Looks like you failed 1 test of 2.
# Failed test at t/compat/inc-propagation.t line 84.
# got: '1'
# expected: '0'
# Failed test '@INC propagated to test'
# at inc_check.t.tmp line 39.
# Structures begin differing at:
# $got-[0] =
'/home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch'
# $expected-[0] = 'wibble'
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/lib,
# wibble,
# t/lib,
# blib/lib,
# blib/arch,
# /home/gabor/perl5lib/lib/i486-linux-gnu-thread-multi,
# /home/gabor/perl5lib/lib,
# /home/gabor/perl5lib/lib/perl/5.8.8,
# /etc/perl,
# /usr/local/lib/perl/5.8.8,
# /usr/local/share/perl/5.8.8,
# /usr/lib/perl5,
# /usr/share/perl5,
# /usr/lib/perl/5.8,
# /usr/share/perl/5.8,
# /usr/local/lib/site_perl
# -
# wibble,
# t/lib,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/lib,
# blib/lib,
# blib/arch,
# /home/gabor/perl5lib/lib/i486-linux-gnu-thread-multi,
# /home/gabor/perl5lib/lib,
# /home/gabor/perl5lib/lib/perl/5.8.8,
# /etc/perl,
# /usr/local/lib/perl/5.8.8,
# /usr/local/share/perl/5.8.8,
# /usr/lib/perl5,
# /usr/share/perl5,
# /usr/lib/perl/5.8,
# /usr/share/perl/5.8,
# /usr/local/lib/site_perl
# Looks like you failed 1 test of 2.
# Failed test at t/compat/inc-propagation.t line 84.
# got: '1'
# expected: '0'
# Looks like you failed 2 tests of 2.
Devel::Cover: Can't open inc_check_taint.t.tmp for MD5 digest: No such
file or directory
Devel::Cover: Deleting old coverage for changed file inc_check_taint.t.tmp
Devel::Cover: Can't open inc_check.t.tmp for MD5 digest: No such file
or directory
Devel::Cover: Deleting old coverage for changed file inc_check.t.tmp
Dubious, test returned 2 (wstat 512, 0x200)
Failed 2/2 subtests
These below appear to be simply the test suite not expecting
HARNESS_PERL_SWITCHES to be set.
t/prove...
# Failed test 'Call with defaults: run results match'
# at t/prove.t line 1376.
# Structures begin differing at:
# $got-[0][1]{switches} = ARRAY(0x89e4528)
# $expected-[0][1]{switches} = Does not exist
# $VAR1 = {
# 'got' = [
# [
#'_runtests',
#{
# 'verbosity' = 0,
# 'switches' = [
# '-MDevel::Cover'
#]
#},
#'TAP::Harness',
#'one',
#'two',
#'three'
# ]
#],
# 'wanted' = [
# [
# '_runtests',
# {
# 'verbosity' = 0
# },
# 'TAP::Harness',
# 'one',
# 'two',
# 'three'
# ]
# ]
# };
# Failed test 'Just argv: run results match'
# at t/prove.t line 1376.
# Structures begin differing at:
# $got-[0][1]{switches} = ARRAY(0x8b8ce78)
# $expected-[0][1]{switches} = Does not exist
# $VAR1 = {
# 'got' = [
# [
#
Test::Harness 3.10 lots of issues under Devel::Cover 0.64
Hi Paul,
I am not sure if this was discussed already but while Test::Harness
3.10 passes its tests
on my Ubuntu 7.10 with perl 5.8.8 it fails when running with Devel::Cover:
Here is the beginning of the 2684 lines of output:
Deleting database /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/cover_db
PERL_DL_NONLAZY=1 /usr/bin/perl -Iblib/lib -Iblib/arch
-MExtUtils::Command::MM -e test_harness(0, 'blib/lib',
'blib/arch') t/*.t t/compat/*.t
t/000-load# Testing Test::Harness 3.10, Perl
5.008008, /usr/bin/perl
ok
t/aggregator..ok
t/bailout.ok
t/baseok
t/callbacks...ok
t/compat/env..ok
t/compat/failure..ok
t/compat/inc-propagation..
# Failed test '@INC propagated to test'
# at inc_check_taint.t.tmp line 38.
# Structures begin differing at:
# $got-[0] =
'/home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch'
# $expected-[0] = 'wibble'
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/lib,
# wibble,
# t/lib,
# blib/lib,
# blib/arch,
# /home/gabor/perl5lib/lib/i486-linux-gnu-thread-multi,
# /home/gabor/perl5lib/lib,
# /home/gabor/perl5lib/lib/perl/5.8.8,
# /etc/perl,
# /usr/local/lib/perl/5.8.8,
# /usr/local/share/perl/5.8.8,
# /usr/lib/perl5,
# /usr/share/perl5,
# /usr/lib/perl/5.8,
# /usr/share/perl/5.8,
# /usr/local/lib/site_perl
# -
# wibble,
# t/lib,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/lib,
# blib/lib,
# blib/arch,
# /home/gabor/perl5lib/lib/i486-linux-gnu-thread-multi,
# /home/gabor/perl5lib/lib,
# /home/gabor/perl5lib/lib/perl/5.8.8,
# /etc/perl,
# /usr/local/lib/perl/5.8.8,
# /usr/local/share/perl/5.8.8,
# /usr/lib/perl5,
# /usr/share/perl5,
# /usr/lib/perl/5.8,
# /usr/share/perl/5.8,
# /usr/local/lib/site_perl
# Looks like you failed 1 test of 2.
# Failed test at t/compat/inc-propagation.t line 84.
# got: '1'
# expected: '0'
# Failed test '@INC propagated to test'
# at inc_check.t.tmp line 39.
# Structures begin differing at:
# $got-[0] =
'/home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch'
# $expected-[0] = 'wibble'
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/lib,
# wibble,
# t/lib,
# blib/lib,
# blib/arch,
# /home/gabor/perl5lib/lib/i486-linux-gnu-thread-multi,
# /home/gabor/perl5lib/lib,
# /home/gabor/perl5lib/lib/perl/5.8.8,
# /etc/perl,
# /usr/local/lib/perl/5.8.8,
# /usr/local/share/perl/5.8.8,
# /usr/lib/perl5,
# /usr/share/perl5,
# /usr/lib/perl/5.8,
# /usr/share/perl/5.8,
# /usr/local/lib/site_perl
# -
# wibble,
# t/lib,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/arch,
# /home/gabor/.cpan/build/Test-Harness-3.10-R6Fkfr/blib/lib,
# blib/lib,
# blib/arch,
# /home/gabor/perl5lib/lib/i486-linux-gnu-thread-multi,
# /home/gabor/perl5lib/lib,
# /home/gabor/perl5lib/lib/perl/5.8.8,
# /etc/perl,
# /usr/local/lib/perl/5.8.8,
# /usr/local/share/perl/5.8.8,
# /usr/lib/perl5,
# /usr/share/perl5,
# /usr/lib/perl/5.8,
# /usr/share/perl/5.8,
# /usr/local/lib/site_perl
# Looks like you failed 1 test of 2.
# Failed test at t/compat/inc-propagation.t line 84.
# got: '1'
# expected: '0'
# Looks like you failed 2 tests of 2.
Devel::Cover: Can't open inc_check_taint.t.tmp for MD5 digest: No such
file or directory
Devel::Cover: Deleting old coverage for changed file inc_check_taint.t.tmp
Devel::Cover: Can't open inc_check.t.tmp for MD5 digest: No such file
or directory
Devel::Cover: Deleting old coverage for changed file inc_check.t.tmp
Dubious, test returned 2 (wstat 512, 0x200)
Failed 2/2 subtests
t/compat/inc_taintok
t/compat/nonumbersok
t/compat/regression...ok
t/compat/test-harness-compat..ok
t/compat/version..ok
t/console.ok
t/errors..ok
t/grammar.ok
t/harness.ok
t/iterators...ok
t/multiplexer.ok
t/nofork-mux..ok
t/nofork..ok
t/parse...ok
t/premature-bailout...ok
t/process.ok
t/prove...
# Failed test 'Call with defaults: run results match'
# at t/prove.t line 1376.
# Structures begin differing at:
# $got-[0][1]{switches} = ARRAY(0x89e4528)
# $expected-[0][1]{switches} = Does not exist
# $VAR1 = {
# 'got' = [
# [
#'_runtests',
#{
# 'verbosity' = 0,
# 'switches' = [
# '-MDevel::Cover'
#
