The investigation that revealed problems in outrigger's FastList and
some of the corresponding test code started from a single failure of a
QA test that usually runs correctly. The failure did not reproduce with
the test as currently checked in. To investigate, I had to drastically
increase the numbers of entries and threads.
Should I check in more stressful versions of some or all of the
outrigger stress tests?
Doing so would further slow down QA, by order minutes for each enhanced
test. On the other hand, I have clear evidence that the current versions
of the tests have low probability of finding concurrency bugs that could
be detected by enhanced versions.
Patricia
- Test speed vs. effectiveness Patricia Shanahan
-