On Mon, Oct 20, 2003 at 08:34:50AM -0700, Ovid wrote: > the suite of 15,000 tests takes about an hour to run.
Devel::Cover issues aside, has anyone else looked at interesting ways of making test suites run faster? We insist on a full regression test on checkin, so having the test suite take a long time to run puts people off making small changes. :( On one project a full regression test takes about 8 minutes, which is at least an order of magnitude longer than I'd like. I couldn't dream of having it take an hour! Interestingly, a lot of this time is due to the fact that we front-load a lot of our stuff to compile time (dynamic class generation etc.) as it's a web-app. This works well under mod_perl, but not so well under testing as just loading the modules to be tested takes a while - which is noticable when it has to happen again for each different test file. So having some way to have that not need to happen for each test file would be nice. Alternatively we looked at running all the test files in parallel rather than sequentially. This was looking promising, but we never got it finished. I'm curious as to whether anyone else is doing anything interesting here... Tony
