Hi Jörg, Jörg Jahnke wrote: > Hi, > > Martin Hollmichel schrieb: >> Andre Schnabel wrote: >>> Hi, >>> >>> -------- Original-Nachricht -------- >>> >>>> Von: Helge Delfs <[email protected]> >>>> >>>> Let me state this and give me a try to help understanding what >>>> automated >>>> testing represents. >>>> >>>> 1. Trust your tools (automated tests, testtool, scripts) >>>> >>> .... >>> >>>> With >>>> results created by automated testers at SUN for me it is proven the >>>> tests are running in general and results created are reproducable. >>> >>> (notice here that this is "at Sun" - QUASTE status clearly shows that >>> this is not the case "outside SUN" >>> >>> >> >> I even don't think that this is a Sun vs. community issue, >> >> I often get the feedback the the automated test run of the last night >> went "red", the QA engineer has to have a look if these are really >> errors and in most cases I get the feedback, this was a "false >> positive", everything is alright. :-( > > There seem to be timing (or similar) problems with some of the test - > which is a bad thing. It just takes time to find and fix these problems. > OTOH there is a set of tests, the Cat0-tests, which should run just fine > and should be reproducable on most if not any system, because these > tests were checked and fixed. > > Andre: Did you try to run the Cat0-tests alone and see whether the > results are the same as those from the tests done here in Hamburg?
I'm not Andre, but running Cat0-tests gave me errors where there seems to be no error for Hamburg. What I usually do when I find errors is: - run the test again with the Testtool - do it manually --> if I find an issue fill it, or ask for checking on #qa.openoffice.org --> sometimes I don't understand what is expected by the test for example: .res says that it is unable to find a Tabpage where I find the Tabpage by manual testing. So what should I do in such cases ? Consider that the script failed? Kind regards Sophie --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
