Status: New
Owner: ----
Labels: Type-Defect Priority-Medium

New issue 1687 by filip.no...@w-friends.de: Support more general merging results with Rebot
http://code.google.com/p/robotframework/issues/detail?id=1687

Hey,

first, some background:

We're using RF to run selenium with ~100.000 test cases across 6 browsers. Obviously, that would take a while if we were to execute them in series. To speed things up, we're using Jenkin's matrix build ability to run test 1-1000 in on job, 1001-2000 in the second job, etc. After all individual jobs have run, we'd like to generate a report that looks *as if* the tests were executed in series (i.e. parallelisation happens transparently).

second, here's a reduced test case 'split_testcases.robot':

*** Testcases ***

Testcase A
    Log        A

Testcase B
    Log        B

When run like

$> pybot split_testcases.robot

one gets a report that has the following hierarchy:

Split Testcases
* Testcase A
* Testcase B

However, when run like this:

$> mkdir run{1,2}
$> pybot --outputdir run1 --test 'Testcase A' split_testcases.robot
$> pybot --outputdir run2 --test 'Testcase B' split_testcases.robot

.. and combined with

$> rebot run{1,2}/output.xml

i get a report that has this hierarchy:

Split Testcases & Split Testcases
 * Split Testcases
   * Testcase A
 * Split Testcases
   * Testcase B

I tried using --rerunmerge, but that fails because the test reports contain disjoint testcases, am I missing a command line flag ?

I think I was able to adapt merger.py posted in https://code.google.com/p/robotframework/issues/detail?id=1615 to create a merged result that resembles my wanted output, simply by removing the check. I think I can work with that for now. However, such functionality sounds useful to other RF users.

Thanks again for Robot Framework :)

--
You received this message because this project is configured to send all issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings

--

--- You received this message because you are subscribed to the Google Groups "robotframework-commit" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to robotframework-commit+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to