[
https://issues.apache.org/jira/browse/CASSANDRA-18942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17904422#comment-17904422
]
Stefan Miklosovic commented on CASSANDRA-18942:
-----------------------------------------------
It is also interesting how it reports results, check this:
{code}
Running tests: org.apache.cassandra.fuzz.snapshots.SnapshotsTest (2 times)
–––– run 0
Buildfile: /home/cassandra/cassandra/build.xml
maybe-build-test:
testclasslist:
[junit-timeout] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was
deprecated in version 9.0 and will likely be removed in a future release.
[junit-timeout] Testsuite:
org.apache.cassandra.fuzz.snapshots.SnapshotsTest-_jdk11_x86_64
[junit-timeout] Testsuite:
org.apache.cassandra.fuzz.snapshots.SnapshotsTest-_jdk11_x86_64 Tests run: 1,
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 110.706 sec
[junit-timeout]
BUILD SUCCESSFUL
Total time: 1 minute 51 seconds
–––– run 1
Buildfile: /home/cassandra/cassandra/build.xml
maybe-build-test:
testclasslist:
[junit-timeout] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was
deprecated in version 9.0 and will likely be removed in a future release.
[junit-timeout] Testsuite:
org.apache.cassandra.fuzz.snapshots.SnapshotsTest-_jdk11_x86_64
[junit-timeout] Testsuite:
org.apache.cassandra.fuzz.snapshots.SnapshotsTest-_jdk11_x86_64 Tests run: 1,
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 122.214 sec
[junit-timeout]
BUILD SUCCESSFUL
Total time: 2 minutes 3 seconds
––––
failure rate: 0/2
Generating Test Summary for test files found under
/home/cassandra/cassandra/build/test/output
[Test Summary] Run: 4, Failed: 3, Errors: 0, Skipped: 0
{code}
Why does it say that "Run: 4, Failed: 3"? I just run it two times and each run
just passed successfully. Maybe it has something to do with the splits?
> Repeatable java test runs on jenkins
> ------------------------------------
>
> Key: CASSANDRA-18942
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18942
> Project: Apache Cassandra
> Issue Type: New Feature
> Components: Build, CI
> Reporter: Berenguer Blasi
> Assignee: Berenguer Blasi
> Priority: Normal
> Fix For: 5.0.3, 5.1
>
> Attachments: CASSANDRA-18942_122_ci_summary.html,
> CASSANDRA-18942_118_ci_summary.html,
> CASSANDRA-18942_118_results_details.tar.xz,
> CASSANDRA-18942_122_results_details.tar.xz, jenkins_job.xml, testJava.txt,
> testJavaDocker.txt, testJavaSplits.txt
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> It is our policy to loop new introduced tests to avoid introducing flakies.
> We also want to add the possibility to repeat a test N number of times to
> test robustness, debug flakies, etc.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
