[
https://issues.apache.org/jira/browse/CASSANDRA-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339516#comment-17339516
]
Berenguer Blasi edited comment on CASSANDRA-16644 at 5/5/21, 8:23 AM:
----------------------------------------------------------------------
The only failure I could track down from [~adelapena] multi run repros the
problem
We can see
[here|https://circle-production-customer-artifacts.s3.amazonaws.com/picard/52e11c3bf7d0f78c41388745/608de58867e0447553dcf233-1-build/artifacts/dtest/stdout.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20210505T081400Z&X-Amz-SignedHeaders=host&X-Amz-Expires=60&X-Amz-Credential=AKIAJR3Q6CR467H7Z55A%2F20210505%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Signature=e0c2ac533b07578c306d0500b9b9c618a04799610ae57e9294a0c50827bea00d]
bq. ccmlib.node.TimeoutError: 02 May 2021 00:01:09 [node4] after 90.12/90
seconds Missing: ['Starting listening for CQL clients'] not found in system.log
it hasn't found it on 00:01:09 when it was already
[present|https://circle-production-customer-artifacts.s3.amazonaws.com/picard/52e11c3bf7d0f78c41388745/608de58867e0447553dcf233-1-build/artifacts/dtest_logs/1619913669551_test_move_backwards_and_cleanup%5B9-10%5D/node4.log?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20210505T081501Z&X-Amz-SignedHeaders=host&X-Amz-Expires=60&X-Amz-Credential=AKIAJR3Q6CR467H7Z55A%2F20210505%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Signature=518882b8276c0aa7947db0d75e58beb67c63be95f5b5540fac1f13fa03e026b8]
at 00:00:27
bq. INFO [main] 2021-05-02 00:00:27,098 PipelineConfigurator.java:125 -
Starting listening for CQL clients on /127.0.0.4:9042 (unencrypted)...
So sthg doesn't add up somewhere indeed...
P.D.: I tracked the failure down manually and I was lucky the 2nd run was
failing as we have missing 'fail/pass' paths in this multi run.
was (Author: bereng):
The only failure I could track down from [~adelapena] multi run repros the
problem
We can see
[here|https://circle-production-customer-artifacts.s3.amazonaws.com/picard/52e11c3bf7d0f78c41388745/608de58867e0447553dcf233-1-build/artifacts/dtest/stdout.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20210505T081400Z&X-Amz-SignedHeaders=host&X-Amz-Expires=60&X-Amz-Credential=AKIAJR3Q6CR467H7Z55A%2F20210505%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Signature=e0c2ac533b07578c306d0500b9b9c618a04799610ae57e9294a0c50827bea00d]
bq. ccmlib.node.TimeoutError: 02 May 2021 00:01:09 [node4] after 90.12/90
seconds Missing: ['Starting listening for CQL clients'] not found in system.log
it hasn't found it on 00:01:09 when it was already present at 00:00:27
bq. INFO [main] 2021-05-02 00:00:27,098 PipelineConfigurator.java:125 -
Starting listening for CQL clients on /127.0.0.4:9042 (unencrypted)...
So sthg doesn't add up somewhere indeed...
> Flaky TestTransientReplicationRing.test_move_backwards_and_cleanup
> ------------------------------------------------------------------
>
> Key: CASSANDRA-16644
> URL: https://issues.apache.org/jira/browse/CASSANDRA-16644
> Project: Cassandra
> Issue Type: Bug
> Components: Test/dtest/python
> Reporter: Berenguer Blasi
> Assignee: Berenguer Blasi
> Priority: Normal
> Fix For: 4.0-rc
>
>
> Failure
> [here|https://ci-cassandra.apache.org/job/Cassandra-trunk/472/testReport/junit/dtest-novnode.transient_replication_ring_test/TestTransientReplicationRing/test_move_backwards_and_cleanup/]
> {noformat}
> Error Message
> ccmlib.node.TimeoutError: 27 Apr 2021 00:01:00 [node4] after 90.11/90 seconds
> Missing: ['Starting listening for CQL clients'] not found in system.log:
> Tail: INFO [main] 2021-04-26 23:59:22,590 YamlConfigura
> Stacktrace
> self = <transient_replication_ring_test.TestTransientReplicationRing object
> at 0x7f66c51ebd90>
> @flaky(max_runs=1)
> @pytest.mark.no_vnodes
> def test_move_backwards_and_cleanup(self):
> """Test moving a node backwards without moving past a neighbor
> token"""
> move_token = '00005'
> expected_after_move = [gen_expected(range(0, 6), range(31, 40)),
> gen_expected(range(0, 21, 2)),
> gen_expected(range(1, 6, 2), range(6, 31)),
> gen_expected(range(7, 20, 2), range(21, 40))]
> expected_after_repair = [gen_expected(range(0, 6), range(31, 40)),
> gen_expected(range(0, 21)),
> gen_expected(range(6, 31)),
> gen_expected(range(21, 40))]
> > self.move_test(move_token, expected_after_move, expected_after_repair)
> transient_replication_ring_test.py:333:
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> _
> transient_replication_ring_test.py:235: in move_test
> node4.start(wait_for_binary_proto=True)
> transient_replication_ring_test.py:50: in new_start
> return old_start(*args, **kwargs)
> ../venv/src/ccm/ccmlib/node.py:901: in start
> self.wait_for_binary_interface(from_mark=self.mark)
> ../venv/src/ccm/ccmlib/node.py:687: in wait_for_binary_interface
> self.watch_log_for("Starting listening for CQL clients", **kwargs)
> ../venv/src/ccm/ccmlib/node.py:588: in watch_log_for
> TimeoutError.raise_if_passed(start=start, timeout=timeout, node=self.name,
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> _
> start = 1619481570.0236456, timeout = 90
> msg = "Missing: ['Starting listening for CQL clients'] not found in
> system.log:\nTail: INFO [main] 2021-04-26 23:59:22,590 YamlConfigura"
> node = 'node4'
> @staticmethod
> def raise_if_passed(start, timeout, msg, node=None):
> if start + timeout < time.time():
> > raise TimeoutError.create(start, timeout, msg, node)
> E ccmlib.node.TimeoutError: 27 Apr 2021 00:01:00 [node4] after
> 90.11/90 seconds Missing: ['Starting listening for CQL clients'] not found in
> system.log:
> E Tail: INFO [main] 2021-04-26 23:59:22,590 YamlConfigura
> ../venv/src/ccm/ccmlib/node.py:56: TimeoutError
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
