[
https://issues.apache.org/jira/browse/CASSANDRA-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206190#comment-17206190
]
Josh McKenzie commented on CASSANDRA-15585:
-------------------------------------------
{quote}It would be nice to see some Harry tests running regularly on say ASF
hardware
{quote}
Strongly agree. I _wouldn't_, however, advocate for using 4.0 as a forcing
function to motivate us to wire up these tests (and fallout tests for
instance). If we believe that configuring recurring runs of these longer
integration tests will either surface new defects or provide protection against
regression in the run up to rc, 100% agree we should do it. If it's about
blocking the release of 4.0 because we don't trust ourselves as a project to
have the discipline to wire these things up...
Past is prologue so that resonates. That said, I'm talking to users multiple
times a week who are asking about 4.0's availability, so I'd advocate we try
and balance those needs.
We as a project could come together and define 4.0.1 as "8 weeks after 4.0
GA's, the goal is to 1) fix anything operators surface in the release, and 2)
have a suite of Harry tests running 24/7 on ASF hardware, and 3) have a fallout
server for ASF C* up and running with adverse scenario tests running".
A little hand-wavy since we don't have a precedent for scoping work to include
in releases up front but maybe moving the "we're going to block" force to the
subsequent patch release could be a reasonable compromise for both the project
community and user community?
> 4.0 quality testing: Test Frameworks, Tooling, Infra / Automation
> -----------------------------------------------------------------
>
> Key: CASSANDRA-15585
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15585
> Project: Cassandra
> Issue Type: Task
> Components: Test/dtest/python
> Reporter: Josh McKenzie
> Priority: Normal
> Fix For: 4.0-beta, 4.0-triage
>
>
> Reference [doc from
> NGCC|https://docs.google.com/document/d/1uhUOp7wpE9ZXNDgxoCZHejHt5SO4Qw1dArZqqsJccyQ/edit#]
> for context.
> *Shepherd: Jordan West*
> This area refers to contributions to test frameworks/tooling (e.g., dtests,
> QuickTheories, CASSANDRA-14821), and automation enabling those tools to be
> applied at scale (e.g., replay testing via Spark-based replay of captured FQL
> logs).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
