[JIRA] (JENKINS-61263) JUnit support flaky test - for multiple records of the same test in xml report

[m...@sumologic.com (JIRA)]

Title: Message Title

Michał Woś created an issue   Jenkins / JENKINS-61263 JUnit support flaky test - for multiple records of the same test in xml report Issue Type: Bug Assignee: Unassigned Components: junit-plugin Created: 2020-02-27 21:39 Priority: Major Reporter: Michał Woś We started to use retry policy while running our tests, because some tests are flaky. We use https://github.com/gradle/test-retry-gradle-plugin for that. The thing is, that a test might appear N times in junit XML report, where N is number of retries. For example 2 times as a "failed" test, and 1 time as "passes". Such test ideally should be marked as flaky and depending on a junit configuration it should not mark the build as unstable/failed.  Current behaviour: It's enough if 1 run of a given test fails and that will make junit plugin to mark build as unstable. Even though there are also positive passes for the same test (separate records in xml). Expected behaviour: Group tests by name, if at least one run is "passes", mark the test as: a) ideal solution: flaky one b) good enough: "passes" one.   There is some another junit jenkins plugin that seems to support flaky tests, but is no longer supported (4 years now) and does not work anymore. It would be nice to add such feature in junit plugin, as discovering flaky tests seems to become a standard. Add Comment   This message was sent by Atlassian Jira (v7.13.12#713012-sha1:6e07c38) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204834.1582839572000.985.1582839600100%40Atlassian.JIRA.