Surefire reports wrong number of failed tests when using JUnit's ErrorCollector
rule
------------------------------------------------------------------------------------
Key: SUREFIRE-779
URL: https://jira.codehaus.org/browse/SUREFIRE-779
Project: Maven Surefire
Issue Type: Bug
Components: Junit 4.7+ (parallel) support
Affects Versions: 2.10
Reporter: Lieven Doclo
When running a test that contains an ErrorCollector, test failures are not
correct when an errorcollector contains failures. For example:
{noformat}
public class ExampleTest {
@Rule
public ErrorCollector errorCollector = new ErrorCollector();
@Test
public void testWithErrorCollector() {
errorCollector.checkThat(true, is(false));
errorCollector.checkThat(3, is(4));
}
}
{noformat}
Surefire will reports 2 tests run (of which all failed). However, when you fix
the same test so that no checks fail, Surefire will report 1 test run.
This is incorrect, as this will result in false information in systems like
Hudson or Sonar, the number of testcase should not fluctuate. Surefire should
only report 1 test run, as that reflects the actual situation.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
