> It is strange... because I'm running w/ fixed seed, RAMDir and > Lucene40 codec. There shouldn't be much variance...
I don't think it's running with a fixed seed. The problem is that junit4 has the same property to control seed (tests.seed) but a different seed format; that's why I suggested a few runs and specifying an empty seed (which is compatible with junit4 and ltc). > for any tests that take > 30 seconds (that test runs alone in the > JVM). So then it's just pulling from that priority queue... I was thinking to do job stealing but then comes the issue of reproducibility (the order of suites sent to a particular jvm) in case the jvm crashes or something. Technically it's easy to do, but after some deliberation I opted for a fixed list of seeds per slave (then you can re-run with the same list because it's on disk, passed as a parameter). @Hoss: > but i wonder if reproducibility might be a problem? if you don't get the > same classpath, and some classes are loaded i na diff order, would you be > able to "cd modules/foo && ant test -D..." and see the same failures? Most likely not. Classpath variations will be an issue. Now that I think of it even load-balancing will be an issue if it's to be calculated from repeatedly updated data. On the other hand, if balancing is calculated from a fixed set of precomputed statistics the quality may vary from system to system... again no good solutions for this I guess. D. --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
