Michael Shuler created CASSANDRA-12904:
------------------------------------------
Summary: dtest failure in
repair_tests.repair_test.TestRepair.simple_sequential_repair_test
Key: CASSANDRA-12904
URL: https://issues.apache.org/jira/browse/CASSANDRA-12904
Project: Cassandra
Issue Type: Test
Reporter: Michael Shuler
Assignee: DS Test Eng
Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log,
node2_debug.log, node2_gc.log, node3.log, node3_debug.log, node3_gc.log
example failure:
http://cassci.datastax.com/job/cassandra-2.2_dtest/710/testReport/repair_tests.repair_test/TestRepair/simple_sequential_repair_test/
{noformat}
Error Message
2001 != 2000
-------------------- >> begin captured logging << --------------------
dtest: DEBUG: cluster ccm directory: /tmp/dtest-gzVU4X
dtest: DEBUG: Done setting configuration options:
{ 'initial_token': None,
'num_tokens': '32',
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 10000,
'read_request_timeout_in_ms': 10000,
'request_timeout_in_ms': 10000,
'truncate_request_timeout_in_ms': 10000,
'write_request_timeout_in_ms': 10000}
dtest: DEBUG: Starting cluster..
cassandra.policies: INFO: Using datacenter 'datacenter1' for
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a
local_dc to the constructor, or limit contact points to local cluster nodes
cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.3 datacenter1>
discovered
cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.2 datacenter1>
discovered
dtest: DEBUG: Inserting data...
cassandra.cluster: WARNING: Host 127.0.0.3 has been marked down
cassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.3, scheduling
retry in 2.0 seconds: [Errno 111] Tried connecting to [('127.0.0.3', 9042)].
Last error: Connection refused
cassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.3, scheduling
retry in 4.0 seconds: [Errno 111] Tried connecting to [('127.0.0.3', 9042)].
Last error: Connection refused
cassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.3, scheduling
retry in 8.0 seconds: [Errno 111] Tried connecting to [('127.0.0.3', 9042)].
Last error: Connection refused
cassandra.pool: INFO: Successful reconnection to 127.0.0.3, marking node up if
it isn't already
cassandra.cluster: INFO: Host 127.0.0.3 may be up; will prepare queries and
open connection pool
cassandra.cluster: INFO: Connection pools established for node 127.0.0.3
dtest: DEBUG: Checking data on node3...
cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.1 datacenter1>
discovered
cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.2 datacenter1>
discovered
--------------------- >> end captured logging << ---------------------
Stacktrace
File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
File "/home/automaton/cassandra-dtest/repair_tests/repair_test.py", line 291,
in simple_sequential_repair_test
self._simple_repair(sequential=True)
File "/home/automaton/cassandra-dtest/repair_tests/repair_test.py", line 386,
in _simple_repair
self._repair_and_verify(sequential)
File "/home/automaton/cassandra-dtest/repair_tests/repair_test.py", line 118,
in _repair_and_verify
self.check_rows_on_node(node3, 2000, missings=[1000])
File "/home/automaton/cassandra-dtest/repair_tests/repair_test.py", line 71,
in check_rows_on_node
self.assertEqual(len(result), rows)
File "/usr/lib/python2.7/unittest/case.py", line 513, in assertEqual
assertion_func(first, second, msg=msg)
File "/usr/lib/python2.7/unittest/case.py", line 506, in _baseAssertEqual
raise self.failureException(msg)
"2001 != 2000\n-------------------- >> begin captured logging <<
--------------------\ndtest: DEBUG: cluster ccm directory:
/tmp/dtest-gzVU4X\ndtest: DEBUG: Done setting configuration options:\n{
'initial_token': None,\n 'num_tokens': '32',\n 'phi_convict_threshold':
5,\n 'range_request_timeout_in_ms': 10000,\n
'read_request_timeout_in_ms': 10000,\n 'request_timeout_in_ms': 10000,\n
'truncate_request_timeout_in_ms': 10000,\n 'write_request_timeout_in_ms':
10000}\ndtest: DEBUG: Starting cluster..\ncassandra.policies: INFO: Using
datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if
incorrect, please specify a local_dc to the constructor, or limit contact
points to local cluster nodes\ncassandra.cluster: INFO: New Cassandra host
<Host: 127.0.0.3 datacenter1> discovered\ncassandra.cluster: INFO: New
Cassandra host <Host: 127.0.0.2 datacenter1> discovered\ndtest: DEBUG:
Inserting data...\ncassandra.cluster: WARNING: Host 127.0.0.3 has been marked
down\ncassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.3,
scheduling retry in 2.0 seconds: [Errno 111] Tried connecting to [('127.0.0.3',
9042)]. Last error: Connection refused\ncassandra.pool: WARNING: Error
attempting to reconnect to 127.0.0.3, scheduling retry in 4.0 seconds: [Errno
111] Tried connecting to [('127.0.0.3', 9042)]. Last error: Connection
refused\ncassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.3,
scheduling retry in 8.0 seconds: [Errno 111] Tried connecting to [('127.0.0.3',
9042)]. Last error: Connection refused\ncassandra.pool: INFO: Successful
reconnection to 127.0.0.3, marking node up if it isn't
already\ncassandra.cluster: INFO: Host 127.0.0.3 may be up; will prepare
queries and open connection pool\ncassandra.cluster: INFO: Connection pools
established for node 127.0.0.3\ndtest: DEBUG: Checking data on
node3...\ncassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.1
datacenter1> discovered\ncassandra.cluster: INFO: New Cassandra host <Host:
127.0.0.2 datacenter1> discovered\n--------------------- >> end captured
logging << ---------------------"
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
