@lamyaa Try to print exec time in the XmlReporterRunTimeIT for Test1: System.out.println( report.getTimeElapsed() )
Because of two methods are concurrent and because of the runorder is not applicable in the first build run, Test1 runs all three methods within 0.8 sec. Each next run would complete within 0.6 sec but this IT does not have run balancer applicable. In reality the class is prolonged by @ Before/AfterClass 2*175 millis, but JUnit RunListener does not provide us with callback methods for test class start/end - only children or complete test set. Test2 should complete within 0.6 sec, and Test3 within 60 millis. The sleep method is not very precise. I would expect discrepancy 10 millis. On Thu, Sep 17, 2015 at 8:21 PM, Tibor17-2 [via Maven] < [email protected]> wrote: > Github user Tibor17 commented on the pull request: > > > https://github.com/apache/maven-surefire/pull/98#issuecomment-141173488 > > @lamyaa > I will have a look into this test. > > On Thu, Sep 17, 2015 at 7:19 PM, lamyaa <[hidden email] > <http:///user/SendEmail.jtp?type=node&node=5845150&i=0>> wrote: > > > @Tibor17 <https://github.com/Tibor17> As I was preparing a new pull > > request with the simple change: > > createTestSuiteElement( ppw, testSetReportEntry, testSetStats, > > reportNameSuffix, testSetReportEntry.elapsedTimeAsString() ) > > I noticed that it makes XmlReporterRunTimeIT fail. Specifically, > this > > assertion: > > assertTrue( "runorder.parallel.Test1 report.getTimeElapsed found:" + > > report.getTimeElapsed(), > > report.getTimeElapsed() >= 1.2f ); > > > > — > > Reply to this email directly or view it on GitHub > > < > https://github.com/apache/maven-surefire/pull/98#issuecomment-141156540>. > > > > > > -- > Cheers > Tibor > > > > --- > If your project is set up for it, you can reply to this email and have > your > reply appear on GitHub as well. If your project does not have this feature > enabled and wishes so, or if the feature is enabled but not working, > please > contact infrastructure at [hidden email] > <http:///user/SendEmail.jtp?type=node&node=5845150&i=1> or file a JIRA > ticket > with INFRA. > --- > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [hidden email] > <http:///user/SendEmail.jtp?type=node&node=5845150&i=2> > For additional commands, e-mail: [hidden email] > <http:///user/SendEmail.jtp?type=node&node=5845150&i=3> > > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://maven.40175.n5.nabble.com/GitHub-maven-surefire-pull-request-Surefire-1144-Time-for-testsuite-on-tp5837601p5845150.html > To start a new topic under Maven Developers, email > [email protected] > To unsubscribe from Maven Developers, click here > <http://maven.40175.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=142166&code=dGlib3JkaWdhbmFAYXBhY2hlLm9yZ3wxNDIxNjZ8LTI4OTQ5MjEwMg==> > . > NAML > <http://maven.40175.n5.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://maven.40175.n5.nabble.com/Re-GitHub-maven-surefire-pull-request-Surefire-1144-Time-for-testsuite-on-tp5845186.html Sent from the Maven Developers mailing list archive at Nabble.com.
