On Wed, 27 Jun 2001, Stas Bekman wrote:
> On Tue, 26 Jun 2001, Doug MacEachern wrote:
>
> > patch looks good stas, but for some reason it now tries to run modules/cgi
> > a bunch of times, which doesn't happen with any other tests:
> >
> > modules/cgi..........ok 2/6Confused test output: test 2 answered after
> > test 2
> > modules/cgi..........ok 2/6Confused test output: test 2 answered after
> > test 2
> > modules/cgi..........NOK 5Use of uninitialized value in string eq at
> > modules/cgi.t line 28.
> > modules/cgi..........dubious
> > Test returned status 9 (wstat 2304, 0x900)
> > DIED. FAILED tests 3-6
> > Failed 4/6 tests, 33.33% okay
> > modules/cgiupload....FAILED tests 1-2
> > Failed 2/2 tests, 0.00% okay
> >
>
> I've seen this too. Are you sure it has anything to do with the patch?
> the patch just shuffles the tests. This error seem to be of a different
> source. Can you reproduce this behavior on demand? Once I've restarted the
> server I didn't see this error anymore, after many different tries.
Ok, I've dug into it. And the problem happens because apparently the tests
are not independent from each other as they should be. Which means that if
you change the order of tests things break. Something I've suggested with
-order=random. In this case my patch essentially does this change:
@tests = sort @tests;
before sending the tests to Test::Harness, if you don't provide any test
list. An innocent change, right? And it's exactly the culprit, which is
great! because it reveals a bug in mod_perl, rather a bug in Apache::Test
:)
I strongly suggest to run --times=20 -order=random and you will see more
anomalies with other tests too.
_____________________________________________________________________
Stas Bekman JAm_pH -- Just Another mod_perl Hacker
http://stason.org/ mod_perl Guide http://perl.apache.org/guide
mailto:[EMAIL PROTECTED] http://apachetoday.com http://eXtropia.com/
http://singlesheaven.com http://perl.apache.org http://perlmonth.com/
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
