[
https://issues.apache.org/jira/browse/CASSANDRA-18942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17779826#comment-17779826
]
Berenguer Blasi commented on CASSANDRA-18942:
---------------------------------------------
Recap so far:
- 2 new scripts run-tests-enhanced.sh are added. These add repeat functionality
and work with getopts format params
- A new [jenkins job|https://ci-cassandra.apache.org/job/Cassandra-5.0-repeat/]
can already be used to fire repeated test runs
- The original run-tests.sh scripts are kept but they just call the new ones.
This allows to A. Not having to modify the current Jenkins DSL and avoiding a
big-bang 'release' of the ticket B. Easy revert of the ticket if needed C.
Compatibility with any other CI integrations or implementations using the
original scripts
- All java repeats should work and results are SSH'ed to nightlies. A cron job
will be requested for periodic cleanup of that folder.
- Python dtests are not working yet
- All Jenkins DSL wotk such as adding the new jenkins job or renaming of
scripts can happen in a later ticket to not de-stabilize CI once this ticket is
merged and seen stable.
> Repeatable test runs
> --------------------
>
> Key: CASSANDRA-18942
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18942
> Project: Cassandra
> Issue Type: New Feature
> Components: Build, CI
> Reporter: Berenguer Blasi
> Assignee: Berenguer Blasi
> Priority: Normal
> Fix For: 5.0, 5.0.x
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> It is our policy to loop new introduced tests to avoid introducing flakies.
> We also want to add the possibility to repeat a test N number of times to
> test robustness, debug flakies, etc.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
