[JIRA] (JENKINS-49339) Add ability to get test results for a given Maven execution

[email protected] (JIRA) Tue, 29 Jan 2019 21:22:59 -0800

Title: Message Title

Cyrille Le Clerc Thanks for hint with ~~JENKINS-41710~~. It took me a while to read all the context of this issue and this lead me to find TestResult#getResultInRun(Run).

I've modified the XWiki pipeline code to find the failing tests from a withMaven execution like this:

 
                                                                /**
 * @return the failing tests for the current build
 */
def getFailingTests()
{
    def failingTests
    AbstractTestResultAction testResultAction = currentBuild.rawBuild.getAction(AbstractTestResultAction.class)
    if (testResultAction != null) {
        failingTests = testResultAction.getResult().getResultInRun(currentBuild.rawBuild).getFailedTests()
    } else {
        // No tests were run in this build, nothing left to do.
        failingTests = []
    }
    return failingTests
}
 
                                                            

I've yet to verify if it works fine (i.e. no more side effects from parallel runs). However I've noticed another problem which feels weird. In the XWiki pipeline we look for failing tests and look for screenshots taken by our selenium tests and attach the screenshot to the Jenkins job page:

This is what we call (full code at https://github.com/xwiki/xwiki-jenkins-pipeline/blob/3a38a609126e5e2007754d9937871a100b029a9b/vars/xwikiBuild.groovy#L467):

 
                                                                def failingTests = getFailingTests() // the method above
...
for (def failedTest : failingTests) {
  def moduleFile = failedTest.getSuiteResult().getFile().getParent().getParent()
...
 
                                                            

The problem is that in some cases the moduleFile for the failing test points to the wrong maven module.

For example in a job I got:

 
                                                                21:34:45.868 [main] INFO  org.xwiki.test.ui.TestDebugger - Screenshot for failing test [NotificationsIT-testNotificationDisplayerClass] saved at [/home/hudsonagent/jenkins_root/workspace/XWiki_xwiki-platform_master/xwiki-platform-core/xwiki-platform-notifications/xwiki-platform-notifications-test/xwiki-platform-notifications-test-tests/target/screenshots/NotificationsIT-testNotificationDisplayerClass.png].

This means the failing test was in module xwiki-platform-notifications-test-tests.

But getSuiteResult().getFile().getParent().getParent() returned /home/hudsonagent/jenkins_root/workspace/XWiki_xwiki-platform_master/xwiki-platform-core/xwiki-platform-activeinstalls/xwiki-platform-activeinstalls-test/xwiki-platform-activeinstalls-test-tests/target, i.e. the xwiki-platform-activeinstalls-test-tests maven module.

Any idea or direction I could check for why the failing test class (CaseResult) would give me a completely wrong file path for the surefire XML report file?

Thanks a lot

Add Comment

--
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
For more options, visit https://groups.google.com/d/optout.

[JIRA] (JENKINS-49339) Add ability to get test results for a given Maven execution

Reply via email to