-----BEGIN PGP SIGNED MESSAGE----- Moin,
On Monday 20 October 2003 19:10, Andy Lester wrote: > > Devel::Cover issues aside, has anyone else looked at interesting ways of > > making test suites run faster? > > One of the drums I beat heavily in my discussion of testing of large > projects is that you shouldn't care how long your tests take, so long as > they run within the smokebot window. > > The way we do it is having an hourly cron job that checks out the main > CVS project and runs a full blown make test on it. This means that we > don't get immediate feedback if a check-in causes a failure, but getting > feedback within 59 minutes is close enough to immediate for me. Also, > smokebot failures are mailed to the entire department (8 people), so > that helps raise the visibility. Good ideas... (but when I start running cronjobs that email me the results of the testsuite I will be officially declared mad. I mean, I am the only developer on the project.. but still, I like the idea *hohum* > We've also had to have a 2nd smokebot running, this time hourly on the > half hour, to check out and smoke the branch for the parallel project > we're running. > > Also, as an FYI, one of the things I'm going to be adding to > Test::Harness soon (Where are those tuits?) is the ability to run the .t > files in random order, in the hopes of exciting bugs that are for some > reason dependent on order of execution. Good idea, except that some testsuites actually depend on the order of the test. I know I have at least written one that did "setup and compile" some stuff in test 00, and then runs the rest, to make sure that it is always run with the latest code - and not manually using the old one.. (Me == bad) Best wishes, Tels - -- Signed on Mon Oct 20 19:30:42 2003 with key 0x93B84C15. Visit my photo gallery at http://bloodgate.com/photos/ PGP key on http://bloodgate.com/tels.asc or per email. "Remember: If the game let's you do it, it's not cheating." -- Xarax -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2-rc1-SuSE (GNU/Linux) Comment: When cryptography is outlawed, bayl bhgynjf jvyy unir cevinpl. iQEVAwUBP5QbwncLPEOTuEwVAQFMiQf9HDAjfd0MSQ6p0no6fVXQTUTJMJxv52Mm oAFcqKLQgOda9+XbK0NLv1O3v9m0YhRgKTl6SKY7YEeDh+PJY/6TiMQEdg6NHG9c meeHJ7857qNoIdNAEEsolBPFjBKnc7v88dUZLxW6HoPhT99mHVnWu9i25HNgBttE zTOCgOjbVQW8MvJIyzZgs5JoCwdXMN54GdsLBreOZDiTStuPUSiVvXDaUCJGic2x C8u6RmBp0VnTQPmeC37JDGm3Y3oY73P+VecL4A8/kZSF/KXwG4Wapd+EV+HYUC2b d4X/8zT12DpTZ2GT91oJIQgnLHhc/U/JVn54m+/bou8jblvSrXLu8Q== =6QCN -----END PGP SIGNATURE-----
