[
https://issues.apache.org/jira/browse/CASSANDRA-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17205628#comment-17205628
]
Jordan West commented on CASSANDRA-15585:
-----------------------------------------
Thanks for summarizing the current status and the previous discussions
[~jmckenzie]. We've made a lot of progress on this ticket even if its not well
reflected. In-jvm dtests have made it much easier to write and debug complex,
multi-node scenarios. Harry (and to a much lesser degree QuickTheories) is now
available and has been used to write some pretty complex tests as well. And
cassandra-diff, which other folks are starting to pick up and use, for example,
in the project you mentioned, is available as well.
Regarding what's left, the biggest area of focus for this ticket, I think,
should be automation -- are we running tests regularly with the tools we built
so that they have the potential to find things:
- For in-jvm dtests, that is already true (at least in circle ci but I believe
that is also the case in Jenkins -- I will check).
- [~ifesdjeen] can you speak to the current level of automation (regular
running) of Harry tests in OSS? I'm not familiar (but can also check if you are
busy)
- We don't have much automation around cassandra-diff but it does sound like
there are some potential projects on the horizon
I think a great stretch goal (or goal for subsequent releases otherwise) would
be the sort automated, cassandra-diff framework mentioned, especially one that
allows for others to contribute schemas, etc. Or maybe breaking it up so we
start it now and add to it in subsequent releases would be a good middle
ground.
> 4.0 quality testing: Test Frameworks, Tooling, Infra / Automation
> -----------------------------------------------------------------
>
> Key: CASSANDRA-15585
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15585
> Project: Cassandra
> Issue Type: Task
> Components: Test/dtest/python
> Reporter: Josh McKenzie
> Priority: Normal
> Fix For: 4.0-beta
>
>
> Reference [doc from
> NGCC|https://docs.google.com/document/d/1uhUOp7wpE9ZXNDgxoCZHejHt5SO4Qw1dArZqqsJccyQ/edit#]
> for context.
> *Shepherd: Jordan West*
> This area refers to contributions to test frameworks/tooling (e.g., dtests,
> QuickTheories, CASSANDRA-14821), and automation enabling those tools to be
> applied at scale (e.g., replay testing via Spark-based replay of captured FQL
> logs).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
