[
https://issues.apache.org/jira/browse/CASSANDRA-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17632571#comment-17632571
]
Ekaterina Dimitrova edited comment on CASSANDRA-18001 at 11/11/22 11:08 PM:
----------------------------------------------------------------------------
So burn tests are solved by removing clean as suggested by Andres. Regarding
the large tests, [~adelapena] spotted a bug in the split command where if we
provide more containers than we have test classes, CircleCI will run all DTests
in the containers that receive an empty split.
I fixed this to fail those containers with a message for the user -
{code:java}
Tune your parallelism, there are more containers then test classes. Nothing to
do in this container{code}
We would need 35 containers for the large DTests in theory at max, so I got 36
containers with low resources and started the tests - [this is how a spare
container would fail now
|https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2083/workflows/20a7da50-8b96-4829-84db-7b80fd94034d/jobs/16455/parallel-runs/35?filterBy=ALL].
(the rest are failures as I didn't want to waste higher resources and run all
tests). I also tuned the large DTests to run on 4 large containers. There are
two tests that fail because there are not enough resources to bring up 9 nodes.
Spinning a 2X Large container for all large tests because of 2 is not
justified.
Also noticed that DTests for 3 and 11 run with 32 and not 16 tokens. I will
open a follow up ticket where we fix that and add a one stop parameter for the
number of tokens for all DTests per branch.
I suggest we commit those two tests failing but open a follow up ticket where
we can pull them in a bigger container and additional job or just remove them.
That will require probably some annotation to be added for them.
I want us now to unblock 4.1 here
I will propagate now the patches to all branches and add the missing Cython
CQLSHLIB tests in 4.0, 4.1 and trunk now when CASSANDRA-18028 and
CASSANDRA-18036 are closed. I will open a follow up ticket for adding the
CQLSHLIB tests for previous branches.
was (Author: e.dimitrova):
So burn tests are solved by removing clean as suggested by Andres. Regarding
the large tests, [~adelapena] spotted a bug in the split command where if we
provide more containers than we have test classes, CircleCI will run all DTests
in the containers that receive an empty split.
I fixed this to fail those containers with a message for the user -
Tune your parallelism, there are more containers then test classes. Nothing to
do in this container
We would need 35 containers for the large DTests in theory at max, so I got 36
containers with low resources and started the tests - [this is how a spare
container would fail now
|https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2083/workflows/20a7da50-8b96-4829-84db-7b80fd94034d/jobs/16455/parallel-runs/35?filterBy=ALL].
(the rest are failures as I didn't want to waste higher resources and run all
tests). I also tuned the large DTests to run on 4 large containers. There are
two tests that fail because there are not enough resources to bring up 9 nodes.
Spinning a 2X Large container for all large tests because of 2 is not
justified.
Also noticed that DTests for 3 and 11 run with 32 and not 16 tokens. I will
open a follow up ticket where we fix that and add a one stop parameter for the
number of tokens for all DTests per branch.
I suggest we commit those two tests failing but open a follow up ticket where
we can pull them in a bigger container and additional job or just remove them.
That will require probably some annotation to be added for them.
I want us now to unblock 4.1 here
I will propagate now the patches to all branches and add the missing Cython
CQLSHLIB tests in 4.0, 4.1 and trunk now when CASSANDRA-18028 and
CASSANDRA-18036 are closed. I will open a follow up ticket for adding the
CQLSHLIB tests for previous branches.
> Add missing tests suites to CircleCI
> ------------------------------------
>
> Key: CASSANDRA-18001
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18001
> Project: Cassandra
> Issue Type: Task
> Components: CI
> Reporter: Ekaterina Dimitrova
> Assignee: Ekaterina Dimitrova
> Priority: Urgent
> Fix For: 3.0.x, 3.11.x, 4.0.x, 4.1-rc, 4.1.x, 4.x
>
>
> Burn tests to all branches, large Python DTests (with/without vnodes),
> cqlshlib not tested in all branches and with all jdks; Java distributed tests
> not running with J8/J11 4.0+
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
