Hi Mathias,
Mathias Bauer schrieb:
...
I know that each and every test I can make is able to find bugs and also
regressions. This is a correct but nevertheless trivial statement that
of course noone would deny. But for the same reason why QA nowadays does
not execute each and every test we have I think we should have a proper
selection for what we perhaps want to make mandatory.
Executing every available test-case we have would indeed lead to the
tests requiring days instead of hours to run. We neither have the
machine power nor do we want to invest this amount of time for every
CWS. And of course no one wants to introduce a new mandatory step that
requires each CWS to take a couple of days longer due to the regression
tests that need to be executed. But I still think that a few hours
machine time for the regression tests are not really a hurdle, given
that the normal QA, which can be done in parallel to the automatic
tests, usually takes a few days.
But I agree that a proper selection of tests is a good idea. Perhaps a
user should be able to call e.g. "dmake regressiontests -run:sw,basic"
to execute special tests for the writer and the basic. Nevertheless I
still think that we should have a set of mandatory tests that everyone
runs before integrating code and that offer a good code coverage.
Efficiency is important. Thus my insisting on first discussing and selecting
the tests
and then deciding how to deal with them. If you think that the 45 test
cases identified by the QA team are a proper selection we should have a
closer look on them and identify which code they test.
OK. I will ask Jogi to give some details on these tests here on the
mailing list.
Regards,
Jörg
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
