Comment #3 on issue 702 by [email protected]: Rerun failed tests based on output.xml of previous run
http://code.google.com/p/robotframework/issues/detail?id=702

Also for us (@COM and NAB project in NSN) it would be very helpful, to have an option, that failed test cases are automatically repeated and the final result of the Robot run combines the result of the orginal run and the re-run. This means a test case is marked as passed, if I passes at least in one run and a test case is only marked as Failed, if it fails in both cases, the original run and the re-run. Our product (NAB) develeopment is done inside MPP (Merlin production pipe). This means we have a completelly automated continuos integration process, with implementation, production, packaging, installation and execution of automatic test cases. A lot of our test cases are implemented as GUI test cases. Even if we have spend already a lot of effort for stabilization of these test case, we face still sometimes sporadic errors (caused by sporadic problems in our product, in the simulator, in the used test libs (SwingLibrary) or in connection between the machines. Therefore the re-execution would be really very helpful for us, as then a Build is only marked as "Red", if the "failure" in the test case is reproducible. But we would prefer a solution, where not only the Failed test cases, but the complete test suite (where the failed test case is included) is repeated, as we have sometimes dependencies between different test cases in one test suite (e.g.: Create NE; Display NE; Modify NE; Delete NE).

Reply via email to