tl;dr: Not everything passed. I think more failed than for Craig on
his system. But it's not much different in its failures from 5.14.0.


I don't know how to get the shared library override set up to do PERL -V
$ MCR []MINIPERL "-Ilib" "-V"
Summary of my perl5 (revision 5 version 16 subversion 0) configuration:
   
  Platform:
    osname=VMS, osvers=V8.4, archname=VMS_IA64
    uname='VMS ptac V8.4 HP rx2600  (1.30GHz/3.0MB)'
    config_args=''
    hint=none, useposix=false, d_sigaction=define
    useithreads=undef, usemultiplicity=undef
    useperlio=define, d_sfio=undef, uselargefiles=define, usesocks=undef
    use64bitint=undef, use64bitall=undef, uselongdouble=undef
    usemymalloc=undef, bincompat5005=undef
  Compiler:
    cc='CC/DECC', ccflags ='/Include=[]/Standard=Relaxed_ANSI/Prefix=All/Obj=.ob
j /NOANSI_ALIAS/float=ieee/ieee=denorm/NAMES=(SHORTENED)/Define=_USE_STD_STAT=1'
,
    optimize='/NoList',
    cppflags='undef'
    ccversion='70390019', gccversion='', gccosandvers='undef'
    intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=1234
    d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16
    ivtype='long', ivsize=4, nvtype='double', nvsize=8, Off_t='off_t', lseeksize
=8
    alignbytes=8, prototype=define
  Linker and Libraries:
    ld='Link/nodebug', ldflags ='/NoTrace/NoMap'
    libpth=/sys$share /sys$library
    libs= 
    perllibs= 
    libc=(DECCRTL), so=exe, useshrplib=true, libperl=undef
    gnulibc_version='undef'
  Dynamic Linking:
    dlsrc=dl_vms.c, dlext=exe, d_dlsymun=undef, ccdlflags=''
    cccdlflags='', lddlflags='/Share'


Characteristics of this PERLSHR image: 
  Compile-time options: HAS_TIMES HAVE_INTERP_INTERN PERLIO_LAYERS
                        PERL_DONT_CREATE_GVSV PERL_EXTERNAL_GLOB
                        PERL_IS_MINIPERL PERL_MALLOC_WRAP PERL_PRESERVE_IVUV
                        USE_IEEE USE_LARGE_FILES USE_LOCALE
                        USE_LOCALE_COLLATE USE_LOCALE_CTYPE
                        USE_LOCALE_NUMERIC USE_PERLIO USE_PERL_ATOF
                        USE_SITECUSTOMIZE VMS_DO_SOCKETS
                        VMS_SHORTEN_LONG_SYMBOLS
  Locally applied patches:
        RC2
  Built under VMS
  Compiled at May 16 2012 11:34:41
  %ENV:
    PERL_CORE="1"
  @INC:
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.cpan.AutoLoader.lib]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.dist.Carp.lib]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.dist.Cwd]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.dist.Cwd.lib]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.dist.ExtUtils-Command.lib]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.dist.ExtUtils-Install.lib]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.cpan.ExtUtils-MakeMaker.lib]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.dist.ExtUtils-Manifest.lib]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.cpan.File-Path.lib]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.ext.re]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK.dist.Term-ReadLine.lib]
    PTAC$DKA0:[NCLARK.I.PERL5160-RC2-MMK]lib
    .


Failures for 5.16.0-RC2

Test Summary Report
-------------------
run/switches.t                                                  (Wstat: 0 Tests:
 112 Failed: 0)
  TODO passed:
23-24, 99-102, 104
../cpan/Archive-Extract/t/01_Archive-Extract.t                  (Wstat: 1024 Tes
ts: 1044 Failed: 90)
  Failed tests:
39, 41-46, 52, 54-59, 128, 130-135, 141
                143-148, 167, 169-174, 180, 182-187, 255
                257-262, 268, 270-275, 294, 296-301, 307
                309-314, 384, 386-387, 389-391, 459, 461-466
                472, 474-479
  Non-zero exit status: 4
../cpan/CGI/t/tmpdir.t                                          (Wstat: 0 Tests:
 9 Failed: 0)
  TODO passed:
3-9
../cpan/ExtUtils-MakeMaker/t/basic.t                            (Wstat: 1024 Tes
ts: 171 Failed: 1)
  Failed test:
62
  Non-zero exit status: 4
../cpan/ExtUtils-MakeMaker/t/fixin.t                            (Wstat: 1024 Tes
ts: 4 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 22 tests but ran 4.
../cpan/Module-Build/t/basic.t                                  (Wstat: 1024 Tes
ts: 58 Failed: 2)
  Failed tests:
22-23
  Non-zero exit status: 4
../cpan/Module-Build/t/compat.t                                 (Wstat: 1024 Tes
ts: 165 Failed: 29)
  Failed tests:
8-10, 26-28, 46-48, 64, 66-67, 83, 85-86
                104-107, 137-146
  Non-zero exit status: 4
../cpan/Module-Build/t/debug.t                                  (Wstat: 1024 Tes
ts: 1 Failed: 1)
  Failed test:
1
  Non-zero exit status: 4
../cpan/Module-Build/t/destinations.t                           (Wstat: 1024 Tes
ts: 113 Failed: 4)
  Failed tests:
47, 50, 107, 110
  Non-zero exit status: 4
../cpan/Module-Build/t/extend.t                                 (Wstat: 1024 Tes
ts: 12 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 64 tests but ran 12.
../cpan/Module-Build/t/install_extra_target.t                   (Wstat: 1024 Tes
ts: 6 Failed: 6)
  Failed tests:
1-6
  Non-zero exit status: 4
../cpan/Module-Build/t/manifypods.t                             (Wstat: 1024 Tes
ts: 14 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 21 tests but ran 14.
../cpan/Module-Build/t/perl_mb_opt.t                            (Wstat: 1024 Tes
ts: 8 Failed: 2)
  Failed tests:
4, 8
  Non-zero exit status: 4
../cpan/Module-Build/t/PL_files.t                               (Wstat: 1024 Tes
ts: 0 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 8 tests but ran 0.
../cpan/Module-Build/t/runthrough.t                             (Wstat: 1024 Tes
ts: 29 Failed: 2)
  Failed tests:
11, 13
  Non-zero exit status: 4
../cpan/Module-Build/t/script_dist.t                            (Wstat: 1024 Tes
ts: 7 Failed: 0)
  Non-zero exit status: 4
../cpan/Module-Build/t/test_file_exts.t                         (Wstat: 1024 Tes
ts: 3 Failed: 2)
  Failed tests:
2-3
  Non-zero exit status: 4
../cpan/Module-Build/t/test_types.t                             (Wstat: 1024 Tes
ts: 25 Failed: 21)
  Failed tests:
2-3, 5-13, 15-16, 18-25
  Non-zero exit status: 4
../cpan/Module-Build/t/tilde.t                                  (Wstat: 1024 Tes
ts: 16 Failed: 1)
  Failed test:
16
  Non-zero exit status: 4
../cpan/Module-Build/t/use_tap_harness.t                        (Wstat: 1024 Tes
ts: 9 Failed: 4)
  Failed tests:
2-3, 6, 9
  Non-zero exit status: 4
../cpan/Module-Build/t/properties/dist_suffix.t                 (Wstat: 1024 Tes
ts: 2 Failed: 1)
  Failed test:
2
  Non-zero exit status: 4
../cpan/Module-Build/t/properties/share_dir.t                   (Wstat: 1024 Tes
ts: 16 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 23 tests but ran 16.
../cpan/Module-Metadata/t/metadata.t                            (Wstat: 1024 Tes
ts: 116 Failed: 3)
  Failed tests:
114-116
  Non-zero exit status: 4
../cpan/Test-Harness/t/source_handler.t                         (Wstat: 1024 Tes
ts: 79 Failed: 4)
  Failed tests:
19-20, 23-24
  Non-zero exit status: 4
../cpan/Test-Harness/t/testargs.t                               (Wstat: 1024 Tes
ts: 8 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 21 tests but ran 8.
../cpan/Time-HiRes/t/alarm.t                                    (Wstat: 1024 Tes
ts: 10 Failed: 2)
  Failed tests:
7, 10
  Non-zero exit status: 4
../cpan/Time-HiRes/t/ualarm.t                                   (Wstat: 1024 Tes
ts: 12 Failed: 2)
  Failed tests:
8, 12
  Non-zero exit status: 4
../ext/Pod-Html/t/cache.t                                       (Wstat: 1024 Tes
ts: 10 Failed: 1)
  Failed test:
8
  Non-zero exit status: 4
../lib/File/Copy.t                                              (Wstat: 0 Tests:
 463 Failed: 0)
  TODO passed:
39, 53, 72
../lib/perl5db.t                                                (Wstat: 0 Tests:
 30 Failed: 4)
  Failed tests:
18-19, 22, 28
Files=2323, Tests=490160, 6924 wallclock secs (211.55 usr +  0.00 sys = 211.55 C
PU)
Result: FAIL


Failures on the same machine for 5.14.0:

Test Summary Report
-------------------
../cpan/Archive-Extract/t/01_Archive-Extract.t                  (Wstat: 1024 Tes
ts: 944 Failed: 118)
  Failed tests:
39, 41-46, 52, 54-59, 128, 130-135, 141
                143-148, 167, 169-174, 180, 182-187, 193
                195-200, 206, 208-213, 255, 257-262, 268
                270-275, 294, 296-301, 307, 309-314, 332
                334-339, 345, 347-352, 358, 360-361, 363-365
                433, 435-440, 446, 448-453
  Non-zero exit status: 4
../cpan/ExtUtils-MakeMaker/t/basic.t                            (Wstat: 1024 Tes
ts: 98 Failed: 1)
  Failed test:
62
  Non-zero exit status: 4
../cpan/ExtUtils-MakeMaker/t/fixin.t                            (Wstat: 1024 Tes
ts: 4 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 22 tests but ran 4.
../cpan/Module-Build/t/basic.t                                  (Wstat: 1024 Tes
ts: 58 Failed: 2)
  Failed tests:
22-23
  Non-zero exit status: 4
../cpan/Module-Build/t/compat.t                                 (Wstat: 1024 Tes
ts: 165 Failed: 29)
  Failed tests:
8-10, 26-28, 46-48, 64, 66-67, 83, 85-86
                104-107, 137-146
  Non-zero exit status: 4
../cpan/Module-Build/t/debug.t                                  (Wstat: 1024 Tes
ts: 1 Failed: 1)
  Failed test:
1
  Non-zero exit status: 4
../cpan/Module-Build/t/destinations.t                           (Wstat: 1024 Tes
ts: 113 Failed: 4)
  Failed tests:
47, 50, 107, 110
  Non-zero exit status: 4
../cpan/Module-Build/t/extend.t                                 (Wstat: 1024 Tes
ts: 12 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 64 tests but ran 12.
../cpan/Module-Build/t/install_extra_target.t                   (Wstat: 1024 Tes
ts: 6 Failed: 6)
  Failed tests:
1-6
  Non-zero exit status: 4
../cpan/Module-Build/t/manifypods.t                             (Wstat: 1024 Tes
ts: 14 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 21 tests but ran 14.
../cpan/Module-Build/t/perl_mb_opt.t                            (Wstat: 1024 Tes
ts: 8 Failed: 2)
  Failed tests:
4, 8
  Non-zero exit status: 4
../cpan/Module-Build/t/PL_files.t                               (Wstat: 1024 Tes
ts: 0 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 8 tests but ran 0.
../cpan/Module-Build/t/runthrough.t                             (Wstat: 1024 Tes
ts: 29 Failed: 2)
  Failed tests:
11, 13
  Non-zero exit status: 4
../cpan/Module-Build/t/script_dist.t                            (Wstat: 1024 Tes
ts: 7 Failed: 0)
  Non-zero exit status: 4
../cpan/Module-Build/t/test_file_exts.t                         (Wstat: 1024 Tes
ts: 3 Failed: 2)
  Failed tests:
2-3
  Non-zero exit status: 4
../cpan/Module-Build/t/test_types.t                             (Wstat: 1024 Tes
ts: 25 Failed: 21)
  Failed tests:
2-3, 5-13, 15-16, 18-25
  Non-zero exit status: 4
../cpan/Module-Build/t/tilde.t                                  (Wstat: 1024 Tes
ts: 16 Failed: 1)
  Failed test:
16
  Non-zero exit status: 4
../cpan/Module-Build/t/use_tap_harness.t                        (Wstat: 1024 Tes
ts: 9 Failed: 4)
  Failed tests:
2-3, 6, 9
  Non-zero exit status: 4
../cpan/Module-Build/t/properties/dist_suffix.t                 (Wstat: 1024 Tes
ts: 2 Failed: 1)
  Failed test:
2
  Non-zero exit status: 4
../cpan/Module-Build/t/properties/share_dir.t                   (Wstat: 1024 Tes
ts: 14 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 21 tests but ran 14.
../cpan/Test-Harness/t/source_handler.t                         (Wstat: 1024 Tes
ts: 79 Failed: 4)
  Failed tests:
19-20, 23-24
  Non-zero exit status: 4
../cpan/Test-Harness/t/testargs.t                               (Wstat: 1024 Tes
ts: 8 Failed: 0)
  Non-zero exit status: 4
  Parse errors: Bad plan.  You planned 21 tests but ran 8.
../cpan/Time-HiRes/t/HiRes.t                                    (Wstat: 0 Tests:
 48 Failed: 4)
  Failed tests:
41, 44-45, 48
../lib/File/Copy.t                                              (Wstat: 0 Tests:
 463 Failed: 0)
  TODO passed:
53
Files=2080, Tests=430164, 6710 wallclock secs (180.04 usr +  0.00 sys = 180.04 C
PU)
Result: FAIL


I haven't investigated to see whether the different test numbers reported are
actually the same underlying tests failing. Also, I've not investigated
whether the new failures are totally new test scripts.

(Been pretty grotty for the past 2 days, and not got anything done. About to
go away for the weekend, offline, hence this rather rushed message)

Nicholas Clark

Reply via email to