On Thu, Feb 28, 2002 at 01:04:31AM -0500, Adam Foxson wrote: > TESTING CATEGORIES > > We are currently bringing many resources to bear on the testing and quality > issues. We currently have tools that fit into three categories. Manual > testing (eg: cpantest), semi automated testing (eg: CPAN::Report), and > fully automated testing (the smoke modules). These categories are all > extremely important yet operate with very few actual testers, and could be > well supplemented by the semi automated testing of hundreds, or thousands > of users
There's the incomplete CPAN::Test to crib from: http://www.pobox.com/~schwern/src/CPAN-Test-0.12.tar.gz There's also CPAN::Test::Reporter to handle the formatting and emailing of cpan test reports, but its currently somewhat broken (the format is wrong). Anyhow, I've got a lot of CPAN testing flotsam floating around that could be dredged back together. > THE NAMESPACE > > If someone has a better suggestion than CPAN::AutoTestReporter, I'm > all ears. The CPAN::Test namespace has already been cracked open. You might want to put it under that. > CONCLUSION > > Thoughts? Comments? Suggestions? Feedback? Thanks for reading! Welp, here's how you'd implement it. Its fairly straightforward, for certain values of straightforward adjusted for MakeMaker. First thing is to write up a way to capture the test results without getting into shell redirects. Simplest way to do that is via Test::Harness::Straps. That'll give you the test results as a data structure, and from there you can generate an email from it. Only problem is trapping STDERR... that's going to be difficult to do in a cross-platform manner, but its something I've been meaning to figure out anyway. Then you need an interface. Simplest thing would be to say "make test_report" in place of "make test" which asks their email address, runs the tests (and all necessary build steps) and emails the report. This requires an easy (for MakeMaker) change to MakeMaker. Since MakeMaker is now on CPAN [1] people can just upgrade MakeMaker to get test report functionality. [1] http://www.cpan.org/authors/id/M/MS/MSCHWERN/ExtUtils-MakeMaker-5.49_01.tar.gz but don't actually use that one, its somewhat broken. Hey, its an alpha. -- Michael G. Schwern <[EMAIL PROTECTED]> http://www.pobox.com/~schwern/ Perl Quality Assurance <[EMAIL PROTECTED]> Kwalitee Is Job One Right Wing Enema: Flush Immorality Now! God gums gay gorgings. -- boojum
