Hi,

this discussion about the quality of the test reports back and forth
is a bit too much for me so let me start a separate thread.

It's good that there are dedicated people who setup smoke testing but
I think what we would need is more diversity both for new and old modules.

It's great to get reports quickly and I believe the current false
negatives will
go away soon (to be replaced by some others later on :-).


For each platform/version (e.g. Netbsd 3.1)
report with its default perl
report with the latest 5.10.x, 5.8.x, 5.6.x and maybe 5.005
(I don't see much value in reports with every 5.8.x)

I'd like to see people also test modules that were uploaded long time ago.
(the latest version of them) and not only the recent uploads.

If you want to give a service to those who don't want to
upgrade then try to figure out what is the newest version of a module
that still works on your platform os.
That is, if you see that the latest of module X fails on a certain platform/perl
then go bacwards in the versions of the module, test each on of them.
In this, I think there is a value in FAIL reports as well but the most
valuable would
be to find the latest version that was still working.


I think most importantly I would like to get reports from *more
people* on their
own system.
I know the few enthusiastic CPAN testers cannot get me those reports
but I think that should be one of our concerns. That way we'll get
more real world
reports.

Gabor

Reply via email to