On Tue, 19 Sep 2006, Heikki Toivonen wrote:
I have a sort of related question regarding test failures. Should we stop further tests as soon as we see the first failure? This would shorten Tinderbox cycle time when there was a problem. What we currently do is that we run all unit tests, and if those passed, we run all functional tests (and if those passed, perf boxes run all perf tests).
Definitely, given the dependencies we have between functional tests, there is no point in running the ones after a failure.
Now, if these dependencies were documented in the code, that is, the test framework knew which ones to skip once a failure was detected, it could proceed with the later ones that don't depend on the earlier one that just failed.
Andi.. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Open Source Applications Foundation "chandler-dev" mailing list http://lists.osafoundation.org/mailman/listinfo/chandler-dev
