[
https://issues.apache.org/jira/browse/CASSANDRA-16238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270738#comment-17270738
]
Michael Semb Wever edited comment on CASSANDRA-16238 at 1/23/21, 7:27 PM:
--------------------------------------------------------------------------
bq. 0% flakiness and 100% stability where the last failures are from a month
ago.
Here's the link(s) based off the latest build (rather than a build number that
will expire to 404 soon)
- [trunk
dtest-novnode|https://ci-cassandra.apache.org/job/Cassandra-trunk/lastCompletedBuild/testReport/dtest-novnode.replace_address_test/TestReplaceAddress/test_insert_data_during_replace_same_address/]
- [trunk
dtest|https://ci-cassandra.apache.org/job/Cassandra-trunk/lastCompletedBuild/testReport/dtest.replace_address_test/TestReplaceAddress/test_insert_data_during_replace_same_address/]
- [trunk
dtest-offheap|https://ci-cassandra.apache.org/job/Cassandra-trunk/lastCompletedBuild/testReport/dtest-offheap.replace_address_test/TestReplaceAddress/test_insert_data_during_replace_same_address/]
h4. Searching nightlies.a.o for past failures…
We can use the nightlies archives for a complete search:
{code}
# webdav mount `https://nightlies.apache.org/cassandra/` to `/Volumes/cassandra`
cd /Volumes/cassandra
# define what we are looking for
export DTEST_CLASS="replace_address_test.TestReplaceAddress"
export DTEST_NAME="test_insert_data_during_replace_same_address"
# find builds where it failed
find Cassandra-trunk-dtest*/label=cassandra,split=* -name nosetests.xml -exec
grep -q ${DTEST_CLASS} {} \; -exec grep -l "name=\"${DTEST_NAME}\"
time=\"[0-9.]*\"><error message" {} \;
# alongside the nosetest.xml files you will find the `test_stdout.txt.xz` and
`ccm_logs.tar.xz` logs
{code}
Alternatively, to control check, find builds where it succeeded
{code}
# alternatively, to control check, find builds where it succeeded
find Cassandra-trunk-dtest*/label=cassandra,split=* -name nosetests.xml -exec
grep -q ${DTEST_CLASS} {} \; -exec grep -l "name=\"${DTEST_NAME}\"
time=\"[0-9.]*\"></testcase>" {} \;
{code}
h4. Past failures and logs
The above recipe lists 54 failures (from currently what is archived in
nighties.a.o).
Links to the folders containing the logs are listed in the attachment
[^16238-archived-failures.txt]
Within just {{Cassandra-trunk-dtest}} there's 17 failures from 193 archived
runs. (9% flakiness)
was (Author: michaelsembwever):
bq. 0% flakiness and 100% stability where the last failures are from a month
ago.
Here's the link(s) based off the latest build (rather than a build number that
will expire to 404 soon)
- [trunk
dtest-novnode|https://ci-cassandra.apache.org/job/Cassandra-trunk/lastCompletedBuild/testReport/dtest-novnode.replace_address_test/TestReplaceAddress/test_insert_data_during_replace_same_address/]
- [trunk
dtest|https://ci-cassandra.apache.org/job/Cassandra-trunk/lastCompletedBuild/testReport/dtest.replace_address_test/TestReplaceAddress/test_insert_data_during_replace_same_address/]
- [trunk
dtest-offheap|https://ci-cassandra.apache.org/job/Cassandra-trunk/lastCompletedBuild/testReport/dtest-offheap.replace_address_test/TestReplaceAddress/test_insert_data_during_replace_same_address/]
h4. Searching nightlies.a.o for past failures…
We can use the nightlies archives for a complete search:
{code}
# webdav mount `https://nightlies.apache.org/cassandra/` to `/Volumes/cassandra`
cd /Volumes/cassandra
# define what we are looking for
export DTEST_CLASS="replace_address_test.TestReplaceAddress"
export DTEST_NAME="test_insert_data_during_replace_same_address"
# find builds where it failed
find Cassandra-trunk-dtest*/label=cassandra,split=* -name nosetests.xml -exec
grep -q ${DTEST_CLASS} {} \; -exec grep -l "name=\"${DTEST_NAME}\"
time=\"[0-9.]*\"><error message" {} \;
# alongside the nosetest.xml files you will find the `test_stdout.txt.xz` and
`ccm_logs.tar.xz` logs
{code}
Alternatively, to control check, find builds where it succeeded
{code}
# alternatively, to control check, find builds where it succeeded
find Cassandra-trunk-dtest*/label=cassandra,split=* -name nosetests.xml -exec
grep -q ${DTEST_CLASS} {} \; -exec grep -l "name=\"${DTEST_NAME}\"
time=\"[0-9.]*\"></testcase>" {} \;
{code}
h4. Past failures and logs
The above recipe lists 54 failures (from currently what is archived in
nighties.a.o).
Links to the folders containing the logs are listed in the attachment …
Within just {{Cassandra-trunk-dtest}} there's 17 failures from 193 archived
runs. (9% flakiness)
> Fix flaky test test_insert_data_during_replace_same_address -
> replace_address_test.TestReplaceAddress
> -----------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-16238
> URL: https://issues.apache.org/jira/browse/CASSANDRA-16238
> Project: Cassandra
> Issue Type: Bug
> Components: Test/dtest/python
> Reporter: David Capwell
> Assignee: Adam Holmberg
> Priority: Normal
> Fix For: 4.0-beta
>
> Attachments: 16238-archived-failures.txt
>
>
> https://app.circleci.com/pipelines/github/dcapwell/cassandra/745/workflows/1c7e589e-b5af-4a56-b40a-43da424602c7/jobs/4231
> {code}
> test teardown failure
> Unexpected error found in node logs (see stdout for full details). Errors:
> [ERROR [main] 2020-10-29 17:38:13,808 CassandraDaemon.java:817 - Exception
> encountered during startup
> java.lang.IllegalStateException: Unable to contact any seeds!
> at
> org.apache.cassandra.service.StorageService.bootstrap(StorageService.java:1601)
> at
> org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:931)
> at
> org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:892)
> at
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:699)
> at
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:635)
> at
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:407)
> at
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:671)
> at
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:795),
> ERROR [main] 2020-10-29 17:38:13,808 CassandraDaemon.java:817 - Exception
> encountered during startup
> java.lang.IllegalStateException: Unable to contact any seeds!
> at
> org.apache.cassandra.service.StorageService.bootstrap(StorageService.java:1601)
> at
> org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:931)
> at
> org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:892)
> at
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:699)
> at
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:635)
> at
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:407)
> at
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:671)
> at
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:795)]
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
