On Sat, 1 Jan 2005 12:48:55 -0500, Ron Jeffries <[EMAIL PROTECTED]> wrote: > Use of "many resources" will not make the tests better. > > Running them asynchronously is done because they take a long time. > The fact that it takes a long time to know if you've done good work > is the bug. Fix it.
Not to beat this to death, but... Some of the ways that you simplify tests and make them run quicker are: simplify use of external resources... Test without databases, Mock out server resources, use smaller data sets. Doesn't it make sense to have some automated tests that test as much as possible under reasonable circumstances? I am NOT saying that you need to run the long tests before/after checkin; you should have quick tests that give you a reasonable level of confidence that things work. But I also don't think that you can say that running more tests is ever bad (or that it is worthless) as long as the testing does not slow down the team. (hence, adding another layer of testing post checkin...) The reality is that if I have a good testable system, using Mock Objects (or other isolation mechanisms), I can run a few tests quickly and be very sure that everything works. But there are always unforseen problems... Some trivial examples or integration problems (I am sure that there are better ones) that you might want to test offline are: - timeout related problems (10 tests with 1 minute pauses will make your tests take too long!) - Large Data Volume issues (I/O time could be long) - Load testing... - Integration level problems that show up as a result of interactive testing... we wrote unit tests that seem to cover them, but we want some assurance that the data sets from "Problem reports 002 thru 9999" no longer cause problems. If nothing else, as a team is getting better at writing developer test and Integration Tests using FIT and other tools, adding this layer of testing can help sponsors feel more comfortable with the transition... -Steve -- Steve Berczuk | [EMAIL PROTECTED] | http://www.berczuk.com SCM Patterns: Effective Teamwork, Practical Integration www.scmpatterns.com To Post a message, send it to: [EMAIL PROTECTED] To Unsubscribe, send a blank message to: [EMAIL PROTECTED] ad-free courtesy of objectmentor.com Yahoo! Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/extremeprogramming/ <*> To unsubscribe from this group, send an email to: [EMAIL PROTECTED] <*> Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
