On Wed, 2011-06-15 at 10:19 +0300, Jeff Zheng wrote: > On 06/15/2011 03:06 PM, Pelkonen Tuomo wrote: > > So should a test plan have different name than tests.xml, for example > > testplan.xml, to avoid confusion and to separate purpose of these files? > > http://wiki.meego.com/Quality/QA-tools/Test_plan > This is another topic. I just prefer to talk about tests.xml in mcts > package. > Again I'd like to repeat that one tests.xml rule defined in release > criteria and guideline for a long time: > http://wiki.meego.com/Quality/TestSuite/MCTS/MCTS_Release_Process > http://wiki.meego.com/Quality/TestSuite/MCTS/MCTS_Development_Guideline > > > Another thing is, now we have packages named differently than before, there > > is no -tests package at all. Is it ok to have test packages named like > > mwts-filesystem-scripts? > Actually I prefer to have one package per test asset, but it's reality > that each mwts test asset has several test packages for a long time. I'm > OK with it. >
One of the issues with tests.xml files is the naming. Calling those xml files test plans seems cause confusion. From automation point of view those files aren't actually plans, they're instructions how to execute the test cases. But the files are used in different contexts so from some point of view it is justified to call them plans. E.g. If there's a need to do a automated test run with selected cases from different test assets/packages you can do a test package (e.g. some-nightly-tests) that contains only the tests.xml file and dependencies to the used assets/packages. The problem with this is that if some asset changes the xml in the test set package also needs to be updated. The issue here has been brought up previously by E-P. He wrote about it to his wiki page http://wiki.meego.com/User:Esmietti#1._Not_designed_to_be_a_test_plan Anyway this is a real issue and needs to be resolved (ASAP). There's currently active discussion about the topic in #meego-qa hopefully the guys participating in it also take the time to follow it up on this mailing list BR -Timo _______________________________________________ MeeGo-qa mailing list [email protected] http://lists.meego.com/listinfo/meego-qa
