On Mon, 2004-02-09 at 15:20 -0800, Stas Bekman wrote:
I've planned to post it here for discussion first....
Well, I think it's an idea that has a lot of value++
At least, provide a way to group tests together in categories and have them each configure/start/stop the server.
I am all in favor.
If we do that, we need to merge in a close issue that we discussed earlier, about providing optional test suites, which won't run on the normal 'make test'.
I can see at least one drawback in the split. We have a good experiance with the case of the main suite vs. the ModPerl-Registry suite. At the moment, if a user has problems with the main suite, they never get to see whether the ModPerl-Registry suite is successful or not. So first they/we get to resolve the main suite's problems and only then they will run the other test suite and possibly find problems there too. So instead of reporting them all at once we get them reported one by one, making the fixing slower. I'm thinking about changing the 'make test' to run a program which will run all the test suites no matter what's their outcome and report the total result at the end, i.e. a failure to run the first test suite doesn't prevent from the second to run.
Another issue is the error_log file. Most users reporting M-R test suite problems, don't realize that they need to look in ModPerl-Registry/t/logs/error_log and not in t/logs/error_log. So I thought that we could again use a driving program which will show the user the right error log file's contents and perhaps write the bug report on their behalf.
't/SMOKE -bug_report' already does something similar, it can match the error entry in the error_log for each failing test, by using tell/seek to the right error_log file. At the moment, the implementation is slow, because we need to feed each test separately to Test::Harness. I need to check on the status of Test::Harness::Straps which was planned to take care of running callbacks before and after each test T::H runs.
__________________________________________________________________ Stas Bekman JAm_pH ------> Just Another mod_perl Hacker http://stason.org/ mod_perl Guide ---> http://perl.apache.org mailto:[EMAIL PROTECTED] http://use.perl.org http://apacheweek.com http://modperlbook.org http://apache.org http://ticketmaster.com
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
