Hi, -------- Original-Nachricht -------- Datum: Thu, 16 Nov 2006 11:56:29 +0100 An: [email protected]
> Andre Schnabel wrote: > > Hi André, > > > Jörg just put the information on the wiki page, what automated tests > are run. Each native lang team is encouraged to run a full set of manual > Tests. > > Everybody is envited to run automated tests and report the bugs. > > > > So "run only sanity tests" can never be the base for a GO/NOGO decision. > > > > And that is a good thing, but it was unfortunately exactly what we did > for 2.0.4 - based our decision on TCM sanity tests alone, No, we did not. > at least for > some platforms and for some languages, unless of course I am unaware of > general qa testing that was done elsewhere, e.g. internally by Sun. Sun is running several automated tests. The results have been announced here at the list. This will be even improved for 2.1. Manual tests have been run by the native lang teams using TCM (not only sanity, but the more general application tests). > This begs the question that if the qa for a given version / language > combination is done internally (e.g. with the qa testtool), why bother > doing sanity checks at all ? Because all the tests are done with a more or less statistical approach. What means, we do not run all the tests for all the languages on all available plattforms. Release sanity checks should verify, that a given build is tested on a given platform for a given language. This should ensure, that somebody had a look at at least the very basic functionality on a installation package before it is delivered to the enduser. André -- Der GMX SmartSurfer hilft bis zu 70% Ihrer Onlinekosten zu sparen! Ideal für Modem und ISDN: http://www.gmx.net/de/go/smartsurfer --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
