I have a similar issue, except my test results some from multiple jobs my basic build pipeline runs unit tests then invokes the systemtest pipeline. These run 10 to 30 times a day. I also have a nightly pipeline that runs a lot of additional tests, like coverage, interop, stress, load, upgrade. It takes many hours so it only runs once a day against whatever basic build is most recent.
I would like to be able to aggregate the test results of the three pipelines together into some master report. I was thinking of creating an external web service that would accept (pointers to) junit xml files and aggregate the results for me. It would also generate links back into jenkins in case I needed to do some investigating. Back to your problem...if the xml path inside your tests is the same regardless of whether the test run includes memchecker, then one set of results might be overwriting the other. Just postprocess the junit files and tweak the paths. I do this now to remove any host or workspace specifics from them so I can compare one build to the next. On Friday, February 14, 2020 at 8:29:52 AM UTC-5, Simon Richter wrote: > > Hi, > > I have a matrix job that in each leaf runs the test suite twice, once > normally and once with memory checking enabled, each of which generates > an XML file that can be parsed with the JUnit parser. > > Now I'd like to present the results in the overview in a useful way: > > 1. separate normal/memcheck runs from the same build > 2. merge results from different cells of the matrix > 3. if tests fail only in some configurations, try to cluster by label > > Problems: > > 1. I have the JUnit plugin parse both generated XML files, but only the > normal test run (<Site><Testing>...</></>)shows up in the result > summary, not the memory checker (<Site><DynamicAnalysis>...</></>). > > 2. Test results are only available inside the matrix configurations, no > summary is available > > 3. I haven't looked at yet, since I need result merging first. > > Simon > > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/99c15303-f0ee-42dd-ba02-2a653e4a06f9%40googlegroups.com.
