James E Keenan <jk...@verizon.net> writes: > CPAN distribution Test-Simple does not appear to be getting adequate > coverage by CPANtesters. > > When I go to this page: > > ##### > http://matrix.cpantesters.org/?dist=Test-Simple > ##### > > ... the main heading says: > > ##### > CPAN Testers Matrix: Test-Simple 2.00_07 > ##### > > If you click through to the reports for any one OS, e.g., > > ##### > http://matrix.cpantesters.org/?dist=Test-Simple%202.00_06;os=linux;perl=5.13.9;reports=1 > ##### > > ... you see that the most recent tests are from this time of year in 2011! > > If you return to the first page and scroll down far enough, you come to: > > ##### > Other versions > > Test-Simple 2.00_06 > Test-Simple 2.00_05 > Test-Simple 2.00_04 > Test-Simple 2.00_03 > Test-Simple 2.00_02 > Test-Simple 2.00_01 > Test-Simple 1.302076-TRIAL > Test-Simple 1.302075 (latest distribution according to latest META > file) > ##### > > If I go to http://search.cpan.org/dist/Test-Simple/, I see that > 1.302075 is the latest release and that 1.302076-TRIAL is the current > "Developer Release". Normally I would expect Test-Simple 1.302075 to > have had hundreds of CPANtesters reports across many versions of Perl > and many different OSes. Instead, all I see is: > > 5.14.2: One test on Darwin > 5.24.1: One test on Cygwin > 5.25.9: One test on Linux > 5.25.10: One test on Linux > > Something is clearly wrong here. > > My hunch is that back in 2011 some Devel version of what was expected > to be Test-Simple 2.00 was picked up by the then current testers and > reports generated -- and that since 2.00_06 is the highest version > number visible, other testers are not picking up the real current > releases. > > In Perl 5 blead, Test-Simple is passing most -- but not all -- of its > test as part of Perl 5 core smoke testing (cf. > http://perl5.test-smoke.org/report/52322 for a failure on OpenBSD). > But we don't have a good idea of how well Test-Simple's most recent > versions across both versions of Perl and OSes. > > Am I missing something? > > How can this be remedied? >
To see the up-to-date test coverage you can switch to the "fast" matrix view --- this is the "Matrix via log.txt" link, the one with the tiny font. The Test-Simple coverage looks quite good, see http://fast-matrix.cpantesters.org/?dist=Test-Simple%201.302075 Unfortunately, in the fast matrix view we see only the test results, but there are no links to the detailed test reports available. It seems that updates into the cpantesters database are delayed. On http://www.cpantesters.org/distro/T/Test-Simple.html I see the note "Please note that this page is in an update queue, and as such the latest data may not be currently available." However, as the stable Test-Simple release happened almost one month ago, I suspect that there could be another problem than just delayed processing. As for the matrix listing the Test-Simple-2.x devel releases on top of the version list --- I think this could be rendered better, maybe using two separate lists for CPAN and BackPAN releases, similar to the metacpan dropdown list. (Something I could do during the Perl Toolchain Summit) Regards, Slaven -- Slaven Rezic - slaven <at> rezic <dot> de Berlin Perl Mongers - http://berlin.pm.org
