[
https://issues.apache.org/jira/browse/SUREFIRE-1795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114367#comment-17114367
]
Tibor Digana commented on SUREFIRE-1795:
----------------------------------------
We wanted to fix this general problem in 3.0.0-M5 but we implemented only "New
interprocess communication with TCP/IP", see the [road
map|https://maven.apache.org/surefire/maven-surefire-plugin/].
This issue is related to the JUnit as well and we have to postpone it to M6.
These milestone versions would rework the code or break some API backwards
compatibility therefore they are milestones.
{noformat}
(4) StatelessXmlReporter repeatedly generates XML report. It is stateful report
and won't work if re-run or parallel executions send test events out of order.
{noformat}
> surefire-reports is not working in parallel
> -------------------------------------------
>
> Key: SUREFIRE-1795
> URL: https://issues.apache.org/jira/browse/SUREFIRE-1795
> Project: Maven Surefire
> Issue Type: Bug
> Components: Maven Surefire Plugin
> Affects Versions: 3.0.0-M4
> Environment: Centos 7 +JDK 1.8.0 + Maven 3.0.5 + surefire plugin
> 2.19.1 + testng 6.8;
> Centos 7 + JDK 1.8.0 + Maven 3.5.2 + surefire plugin 2.19.1 + testng 6.8;
> Windows 10 + JDK 1.8.0 + Maven 3.5.0 + surefirel plugin 3.0.0-M4 + testng 6.8;
>
> Reporter: QIAO YU
> Priority: Major
> Fix For: 3.0.0-M6
>
>
> Create a maven project, add 4 testng classes to print out logs, for example:
> {code:java}
> package com.verizon.rngverify;
> import org.testng.annotations.Test;
> public class testClass1 {
> @Test public void test1() throws Exception {
> System.out.println("class1method1");
> Thread.sleep(100);
> System.out.println("class1method1 end");
> }
> }
> {code}
>
> Create a testng xml file to control above 4 test cases in parallel with 4
> threads:
> {code:java}
> <suite name="tsname" parallel="tests" thread-count="4" verbose="1">
> <test name="testname1_in_xml" >
> <classes>
> <class name="com.verizon.rngverify.testClass1"/>
> </classes>
> </test>
>
> <test name="testname2_in_xml">
> <classes>
> <class name="com.verizon.rngverify.testClass2"/>
> </classes>
> </test>
> <test name="testname3_in_xml">
> <classes>
> <class name="com.verizon.rngverify.testClass3" />
> </classes>
> </test>
> <test name="testname4_in_xml">
> <classes>
> <class name="com.verizon.rngverify.testClass4" />
> </classes>
> </test>
> </suite>
> {code}
>
> Use surefire plugin in pom:
> {code:java}
> <plugins>
> <plugin>
> <groupId>org.apache.maven.plugins</groupId>
> <artifactId>maven-compiler-plugin</artifactId>
> <version>3.7.0</version>
> <configuration> <source>1.8</source> <target>1.8</target>
> </configuration>
> </plugin>
> <plugin>
> <groupId>org.apache.maven.plugins</groupId>
> <artifactId>maven-surefire-plugin</artifactId>
> <version>3.0.0-M4</version>
> <configuration>
> <suiteXmlFiles> <file>src/test/resources/ts1234.xml</file>
> </suiteXmlFiles>
> </configuration>
> </plugin>
> </plugins>
> {code}
> Run above project:
> mvn clean install
>
> ...
> [INFO] -------------------------------------------------------
> [INFO] T E S T S
> [INFO] -------------------------------------------------------
> [INFO] Running TestSuite
> class1method1
> class2method1
> class3method1
> class4method1
> class2method1 end
> class3method1 end
> class4method1 end
> class1method1 end
> [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.617
> s - in TestSuite
> ...
>
> But in ${project}/target/surefire-reports/testng-results.xml, only 3 cases
> were found. Also under ${project}/target/surefire-reports/junitreports
> folder, only 3 files were generated.
>
> In general, if the thread-count > 1, it happens randomly.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
