winglam opened a new pull request #309: URL: https://github.com/apache/maven-surefire/pull/309
The changes in this pull request addresses issue SUREFIRE-756. Namely, the changes include - Output of the random seed used to generate a particular random test order when -Dsurefire.runOrder=random is set - Ability to replay a previously observed random test order by setting -Dsurefire.seed and -Dfailsafe.seed to the seed that observed the random test order - Tests to ensure that the setting of the _same_ random seeds do create the _same_ test orders and _different_ random seeds do create _different_ test orders. Note that the inherent randomness of the orders does mean the tests can be flaky (nondeterministically pass or fail without changes to the code). The current tests have a rate of 0.4% ```(1/3)^5``` of failing. Increasing the number of tests (3) or the number of times to loop (5) would decrease the odds of the test failing. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
