Hi Sophie, hi Andre,
thanks for the information. So there seem to be some problems even with
the Cat0-tests. Hopefully it will be possible to improve those of the
Cat0-tests that not yet run reliably, so that we can get at least a
small set of tests that run reliably inside Sun as well as outside Sun.
Regards,
Jörg
sophie schrieb:
Hi Jörg,
Jörg Jahnke wrote:
Hi,
Martin Hollmichel schrieb:
Andre Schnabel wrote:
Hi,
-------- Original-Nachricht --------
Von: Helge Delfs <[email protected]>
Let me state this and give me a try to help understanding what
automated
testing represents.
1. Trust your tools (automated tests, testtool, scripts)
....
With
results created by automated testers at SUN for me it is proven the
tests are running in general and results created are reproducable.
(notice here that this is "at Sun" - QUASTE status clearly shows that
this is not the case "outside SUN"
I even don't think that this is a Sun vs. community issue,
I often get the feedback the the automated test run of the last night
went "red", the QA engineer has to have a look if these are really
errors and in most cases I get the feedback, this was a "false
positive", everything is alright. :-(
There seem to be timing (or similar) problems with some of the test -
which is a bad thing. It just takes time to find and fix these problems.
OTOH there is a set of tests, the Cat0-tests, which should run just fine
and should be reproducable on most if not any system, because these
tests were checked and fixed.
Andre: Did you try to run the Cat0-tests alone and see whether the
results are the same as those from the tests done here in Hamburg?
I'm not Andre, but running Cat0-tests gave me errors where there seems
to be no error for Hamburg.
What I usually do when I find errors is:
- run the test again with the Testtool
- do it manually
--> if I find an issue fill it, or ask for checking on #qa.openoffice.org
--> sometimes I don't understand what is expected by the test for
example: .res says that it is unable to find a Tabpage where I find the
Tabpage by manual testing. So what should I do in such cases ? Consider
that the script failed?
Kind regards
Sophie
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
