[ https://issues.apache.org/jira/browse/SUREFIRE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410763#comment-16410763 ]
ASF GitHub Bot commented on SUREFIRE-1372: ------------------------------------------ adarshkv commented on issue #150: SUREFIRE-1372 Filter tests to be rerun by description URL: https://github.com/apache/maven-surefire/pull/150#issuecomment-375536168 Hi All.. with the new version of maven-surefire 2.21.0 and cucumber-jvm 2.4.0 (io.cucucmber)... we are able to perform rerun's successfully. However, I am facing a new issue with regards to reporting... in our project we have integrated our reports with VSTS i.e. after I perform parallel execution (using docker container) all the reports are getting generated with TEST-.(*).xml and VSTS then consolidates all the .xml files to give us a single report after parallel execution. But in the XML the testcase names are missing i.e. we are not able to view each step definitions (step-step names Given When Then) rather I am seeing only the scenario name as a result.. is anyone aware why we are having this ? and how we can resolve this issue? **Below is my XML file if i am using info.cukes as group ID for execution (cucumber-jvm v 1.2.5) -- Rerun doesnt work here but test case name is available.** <property name="sun.io.unicode.encoding" value="UnicodeLittle"/> <property name="java.class.version" value="52.0"/> </properties> **<testcase name="Given I am on the xxxx home page" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="When I click on Login Profile on home page" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="And I click on sign up in login page" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="Then I click on Sign Up" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="And I should see the valid message "The sign up was not successful." and "There are 6 field(s) that require your attention."" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="And I should see error message for first name "First name is required."" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0.008"/> <testcase name="And I should see error message for last name "Last name is required."" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="And I should see error message for email address "Email address is required."" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="And I should see error message for password "Password is required."" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="And I should see error message for preferred contact number "Phone number is required."" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="And I should see error message for delivery address "Address is required."" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/> <testcase name="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="1.288"/>** </testsuite> **Below is the my XML file if I am using io.cucumber as group id for execution (cucumber-jvm v 2.4.0) --- Rerun works perfectly fine but testcase name is missing** <property name="sun.io.unicode.encoding" value="UnicodeLittle"/> <property name="java.class.version" value="52.0"/> </properties> **<testcase name="Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" classname="Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="18.391"/>** </testsuite> ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Rerunning failing tests fails in combination with > Description#createSuiteDescription > ------------------------------------------------------------------------------------ > > Key: SUREFIRE-1372 > URL: https://issues.apache.org/jira/browse/SUREFIRE-1372 > Project: Maven Surefire > Issue Type: Bug > Components: Maven Surefire Plugin > Affects Versions: 2.20 > Reporter: M.P. Korstanje > Assignee: Tibor Digana > Priority: Major > Fix For: 2.21.0 > > > When using surefire to rerun failing tests created by a Runner that uses > {noformat}Description#createSuiteDescription{noformat} with a human readable > name rather then a class name the following stack trace occurs: > {code} > org.apache.maven.surefire.testset.TestSetFailedException: Unable to create > test class 'Scenario: Fail when running' > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeFailedMethod(JUnit4Provider.java:385) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:292) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) > at > org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161) > Caused by: java.lang.ClassNotFoundException: Scenario: Fail when running > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeFailedMethod(JUnit4Provider.java:379) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:292) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) > at > org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)