On Wed, Sep 03, 2008 at 03:00:40PM +0300, Gabor Szabo wrote:

> It's good that there are dedicated people who setup smoke testing but
> I think what we would need is more diversity both for new and old modules.
> 
> For each platform/version (e.g. Netbsd 3.1)
> report with its default perl

This requires the tester to have the infrastructure in place to clean up
afterwards - probably by running in a VM (which itself limits testing to
NetBSD only on platforms which support VMs - so no NetBSD on Alpha, for
example) and blowing the whole machine away and replacing it with a
clean one periodically.  I believe some people are already doing this.

> report with the latest 5.10.x, 5.8.x, 5.6.x and maybe 5.005

I test with 5.10.0, 5.8.8 and 5.6.2 on Linux, but not elsewhere.  I
assume that it's sufficient to cover each version of perl once, and each
platform once, so on other platforms I just test with 5.10.0 (or 5.8.8
on Irix, cos I had trouble building 5.10.0).

> I'd like to see people also test modules that were uploaded long time ago.
> (the latest version of them) and not only the recent uploads.

I did this some time ago and have tested everything uploaded since
(except those that I've deliberately excluded from testing for various
reasons).  It annoyed a fair number of people, partly because my
algorithm for figuring out what's the most recent was a bit stupid and
so if a module changed maintainer it tested both USERFOO/Some-Module-1.0
and USERBAR/Some-Module-3.7.  Also, while I was doing this on several
platforms, I stopped them all as soon as one reached the end.  Mostly
because it was taking a lot of my time.

I believe that brian d foy has recently been doing some backpan
archaeology, so it might be worth someone else doing this at some point
once he's written some nice tools.

> If you want to give a service to those who don't want to
> upgrade then try to figure out what is the newest version of a module
> that still works on your platform os.

These go some way towards that:

http://bbbike.radzeit.de/~slaven/cpantestersmatrix.cgi?dist=CGI-Upload%201.11;maxver=1
http://bbbike.radzeit.de/~slaven/cpantestersmatrix.cgi?dist=CGI-Upload%201.11

which is linked as "Perl/Platform Version Matrix" from search.cpan.org.

-- 
David Cantrell | top google result for "internet beard fetish club"

You don't need to spam good porn

Reply via email to