[
https://issues.apache.org/jira/browse/CASSANDRA-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17205493#comment-17205493
]
Josh McKenzie commented on CASSANDRA-15585:
-------------------------------------------
Pulling directly from the NGCC discussion doc, I think these are the items that
apply to this ticket:
{quote} # Targeting Fuzzing (Integration)
# Have all the targeted fuzz test tooling executed as a pre-release task prior
to all new builds being published.
# Integration with Circle CI.
# Ability to launch for execution on any platform (launch script) to enable
at-scale execution on elastic compute infra.
# Netflix Fuzz testing
# Writes data with checksum, later reads out to validate.{quote}
Given the description: _and automation enabling those tools to be applied at
scale (e.g., replay testing via Spark-based replay of captured FQL logs)._
As far as I know, there's not plans to open source anything wiring FQLTool and
cassandra-diff together, though [~gianluca] has been working on a project we're
going to be open sourcing within a couple weeks that ties generative workload
fuzzing with gemini and nosqlbench based on anonymized schemas and using
[cassandra-diff|[https://github.com/apache/cassandra-diffhttp://example.com|https://github.com/apache/cassandra-diff]]
to verify cluster state after.
So [~jwest] any thoughts on how this ticket / effort may have evolved to today?
in-jvm dtests are working well and, while FQLTool *exists* I don't know that
it's integrated with our primary ci/cd pipeline.
We don't have a corpus of real schemas and/or workloads publicly available to
the project as yet to integrate as a pre-release checkpoint. Ultimately, I
think the project I alluded to above checks the box on 1 of the above 4 items
but I don't know how realistic it is for us to have fuzzing integrated as a
pre-release action unless there are folks with workloads or schemas that are
currently not open source they'll be able to bring forward.
> 4.0 quality testing: Test Frameworks, Tooling, Infra / Automation
> -----------------------------------------------------------------
>
> Key: CASSANDRA-15585
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15585
> Project: Cassandra
> Issue Type: Task
> Components: Test/dtest/python
> Reporter: Josh McKenzie
> Priority: Normal
> Fix For: 4.0-beta
>
>
> Reference [doc from
> NGCC|https://docs.google.com/document/d/1uhUOp7wpE9ZXNDgxoCZHejHt5SO4Qw1dArZqqsJccyQ/edit#]
> for context.
> *Shepherd: Jordan West*
> This area refers to contributions to test frameworks/tooling (e.g., dtests,
> QuickTheories, CASSANDRA-14821), and automation enabling those tools to be
> applied at scale (e.g., replay testing via Spark-based replay of captured FQL
> logs).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
