Michael Kjellman created CASSANDRA-14048: --------------------------------------------
Summary: test_ttl_deletions - paging_test.TestPagingWithDeletions fails: [Unavailable exception] Key: CASSANDRA-14048 URL: https://issues.apache.org/jira/browse/CASSANDRA-14048 Project: Cassandra Issue Type: Bug Components: Testing Reporter: Michael Kjellman test_ttl_deletions - paging_test.TestPagingWithDeletions fails: [Unavailable exception] Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level ALL" info={'required_replicas': 2, 'alive_replicas': 1, 'consistency': 'ALL'} -------------------- >> begin captured logging << -------------------- dtest: DEBUG: cluster ccm directory: /tmp/dtest-lCOixs dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '32', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 10000, 'read_request_timeout_in_ms': 10000, 'request_timeout_in_ms': 10000, 'truncate_request_timeout_in_ms': 10000, 'write_request_timeout_in_ms': 10000} cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.9 dc3> discovered cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.3 datacenter1> discovered cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.7 dc3> discovered cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.2 datacenter1> discovered cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.4 dc2> discovered cassandra.cluster: WARNING: Failed to create connection pool for new host 127.0.0.9: Traceback (most recent call last): File "cassandra/cluster.py", line 2452, in cassandra.cluster.Session.add_or_renew_pool.run_add_or_renew_pool new_pool = HostConnection(host, distance, self) File "cassandra/pool.py", line 332, in cassandra.pool.HostConnection.__init__ self._connection = session.cluster.connection_factory(host.address) File "cassandra/cluster.py", line 1195, in cassandra.cluster.Cluster.connection_factory return self.connection_class.factory(address, self.connect_timeout, *args, **kwargs) File "cassandra/connection.py", line 332, in cassandra.connection.Connection.factory conn = cls(host, *args, **kwargs) File "/home/cassandra/env/src/cassandra-driver/cassandra/io/asyncorereactor.py", line 344, in __init__ self._connect_socket() File "cassandra/connection.py", line 371, in cassandra.connection.Connection._connect_socket raise socket.error(sockerr.errno, "Tried connecting to %s. Last error: %s" % ([a[4] for a in addresses], sockerr.strerror or sockerr)) error: [Errno 111] Tried connecting to [('127.0.0.9', 9042)]. Last error: Connection refused cassandra.cluster: WARNING: Failed to create connection pool for new host 127.0.0.4: Traceback (most recent call last): File "cassandra/cluster.py", line 2452, in cassandra.cluster.Session.add_or_renew_pool.run_add_or_renew_pool new_pool = HostConnection(host, distance, self) File "cassandra/pool.py", line 332, in cassandra.pool.HostConnection.__init__ self._connection = session.cluster.connection_factory(host.address) File "cassandra/cluster.py", line 1195, in cassandra.cluster.Cluster.connection_factory return self.connection_class.factory(address, self.connect_timeout, *args, **kwargs) File "cassandra/connection.py", line 332, in cassandra.connection.Connection.factory conn = cls(host, *args, **kwargs) File "/home/cassandra/env/src/cassandra-driver/cassandra/io/asyncorereactor.py", line 344, in __init__ self._connect_socket() File "cassandra/connection.py", line 371, in cassandra.connection.Connection._connect_socket raise socket.error(sockerr.errno, "Tried connecting to %s. Last error: %s" % ([a[4] for a in addresses], sockerr.strerror or sockerr)) error: [Errno 111] Tried connecting to [('127.0.0.4', 9042)]. Last error: Connection refused cassandra.cluster: WARNING: Host 127.0.0.9 has been marked down cassandra.cluster: WARNING: Host 127.0.0.4 has been marked down cassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.9, scheduling retry in 2.0 seconds: [Errno 111] Tried connecting to [('127.0.0.9', 9042)]. Last error: Connection refused cassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.4, scheduling retry in 2.0 seconds: [Errno 111] Tried connecting to [('127.0.0.4', 9042)]. Last error: Connection refused dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #0 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #3 dtest: DEBUG: Retrying request after UE. Attempt #4 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #1 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 dtest: DEBUG: Retrying request after UE. Attempt #2 --------------------- >> end captured logging << --------------------- File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/cassandra/cassandra-dtest/paging_test.py", line 3425, in test_ttl_deletions data = self.setup_data() File "/home/cassandra/cassandra-dtest/paging_test.py", line 3191, in setup_data 'col3': int File "/home/cassandra/cassandra-dtest/tools/datahelp.py", line 158, in create_rows query_results = execute_concurrent_with_args(session, prepared, [d.values() for d in dicts]) File "cassandra/concurrent.py", line 236, in cassandra.concurrent.execute_concurrent_with_args return execute_concurrent(session, zip(cycle((statement,)), parameters), *args, **kwargs) File "cassandra/concurrent.py", line 92, in cassandra.concurrent.execute_concurrent return executor.execute(concurrency, raise_on_first_error) File "cassandra/concurrent.py", line 199, in cassandra.concurrent.ConcurrentExecutorListResults.execute return super(ConcurrentExecutorListResults, self).execute(concurrency, fail_fast) File "cassandra/concurrent.py", line 118, in cassandra.concurrent._ConcurrentExecutor.execute return self._results() File "cassandra/concurrent.py", line 213, in cassandra.concurrent.ConcurrentExecutorListResults._results with self._condition: File "cassandra/concurrent.py", line 217, in cassandra.concurrent.ConcurrentExecutorListResults._results self._raise(self._exception) File "cassandra/concurrent.py", line 165, in cassandra.concurrent._ConcurrentExecutor._raise raise exc 'Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level ALL" info={\'required_replicas\': 2, \'alive_replicas\': 1, \'consistency\': \'ALL\'}\n-------------------- >> begin captured logging << --------------------\ndtest: DEBUG: cluster ccm directory: /tmp/dtest-lCOixs\ndtest: DEBUG: Done setting configuration options:\n{ \'initial_token\': None,\n \'num_tokens\': \'32\',\n \'phi_convict_threshold\': 5,\n \'range_request_timeout_in_ms\': 10000,\n \'read_request_timeout_in_ms\': 10000,\n \'request_timeout_in_ms\': 10000,\n \'truncate_request_timeout_in_ms\': 10000,\n \'write_request_timeout_in_ms\': 10000}\ncassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.9 dc3> discovered\ncassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.3 datacenter1> discovered\ncassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.7 dc3> discovered\ncassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.2 datacenter1> discovered\ncassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.4 dc2> discovered\ncassandra.cluster: WARNING: Failed to create connection pool for new host 127.0.0.9:\nTraceback (most recent call last):\n File "cassandra/cluster.py", line 2452, in cassandra.cluster.Session.add_or_renew_pool.run_add_or_renew_pool\n new_pool = HostConnection(host, distance, self)\n File "cassandra/pool.py", line 332, in cassandra.pool.HostConnection.__init__\n self._connection = session.cluster.connection_factory(host.address)\n File "cassandra/cluster.py", line 1195, in cassandra.cluster.Cluster.connection_factory\n return self.connection_class.factory(address, self.connect_timeout, *args, **kwargs)\n File "cassandra/connection.py", line 332, in cassandra.connection.Connection.factory\n conn = cls(host, *args, **kwargs)\n File "/home/cassandra/env/src/cassandra-driver/cassandra/io/asyncorereactor.py", line 344, in __init__\n self._connect_socket()\n File "cassandra/connection.py", line 371, in cassandra.connection.Connection._connect_socket\n raise socket.error(sockerr.errno, "Tried connecting to %s. Last error: %s" % ([a[4] for a in addresses], sockerr.strerror or sockerr))\nerror: [Errno 111] Tried connecting to [(\'127.0.0.9\', 9042)]. Last error: Connection refused\ncassandra.cluster: WARNING: Failed to create connection pool for new host 127.0.0.4:\nTraceback (most recent call last):\n File "cassandra/cluster.py", line 2452, in cassandra.cluster.Session.add_or_renew_pool.run_add_or_renew_pool\n new_pool = HostConnection(host, distance, self)\n File "cassandra/pool.py", line 332, in cassandra.pool.HostConnection.__init__\n self._connection = session.cluster.connection_factory(host.address)\n File "cassandra/cluster.py", line 1195, in cassandra.cluster.Cluster.connection_factory\n return self.connection_class.factory(address, self.connect_timeout, *args, **kwargs)\n File "cassandra/connection.py", line 332, in cassandra.connection.Connection.factory\n conn = cls(host, *args, **kwargs)\n File "/home/cassandra/env/src/cassandra-driver/cassandra/io/asyncorereactor.py", line 344, in __init__\n self._connect_socket()\n File "cassandra/connection.py", line 371, in cassandra.connection.Connection._connect_socket\n raise socket.error(sockerr.errno, "Tried connecting to %s. Last error: %s" % ([a[4] for a in addresses], sockerr.strerror or sockerr))\nerror: [Errno 111] Tried connecting to [(\'127.0.0.4\', 9042)]. Last error: Connection refused\ncassandra.cluster: WARNING: Host 127.0.0.9 has been marked down\ncassandra.cluster: WARNING: Host 127.0.0.4 has been marked down\ncassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.9, scheduling retry in 2.0 seconds: [Errno 111] Tried connecting to [(\'127.0.0.9\', 9042)]. Last error: Connection refused\ncassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.4, scheduling retry in 2.0 seconds: [Errno 111] Tried connecting to [(\'127.0.0.4\', 9042)]. Last error: Connection refused\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #0\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #3\ndtest: DEBUG: Retrying request after UE. Attempt #4\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #1\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\ndtest: DEBUG: Retrying request after UE. Attempt #2\n--------------------- >> end captured logging << ---------------------' -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org