Do you see any errors in the system.log for DSE/Cassandra?
On Thu, Jan 16, 2014 at 9:19 AM, Amalrik Maia <amal...@s1mbi0se.com.br>wrote:
> Hi guys,
> i have some issues with an application on a cassandra multinode cluster.
> I need help to understand what is going on.
>
> here is the stack trace of my application.
>
> 2014-01-16 12:33:14,176 - root - ERROR -
> ------------------------------------------------------------
> 2014-01-16 12:33:14,176 - root - ERROR - Task finished processing with
> exception, message will be kept in the queue
> 2014-01-16 12:33:14,180 - pycassa.pool - INFO - Connection 42979792
> (cassandra.*******.com:9160) in pool 42966096 failed:
> 2014-01-16 12:33:14,182 - pycassa.pool - INFO - Connection 42979408
> (cassandra.*******.com:9160) in pool 42966096 failed:
> 2014-01-16 12:33:14,182 - pycassa.pool - INFO - Connection 42966864
> (cassandra.*******.com:9160) in pool 42966096 failed:
> 2014-01-16 12:33:14,183 - root - ERROR - Exception in user code:
> 2014-01-16 12:33:14,183 - root - ERROR -
> ------------------------------------------------------------
> 2014-01-16 12:33:14,183 - root - ERROR - (<class
> 'pycassa.pool.MaximumRetryException'>, MaximumRetryException('Retried 1
> times. Last failure was EOFError: ',), <traceback object at 0x28fe3b0>)
> 2014-01-16 12:33:14,183 - root - ERROR - Traceback (most recent call last):
>
> File "acme.py", line 20, in task_run
>
> run_method_result = run_method(message.get_body())
>
> File "/opt/acme/acme/acme/apps/stats_updater/stats_updater.py", line 141,
> in acme_run
>
> StatsUpdater.get().run(params)
>
> File "/opt/acme/acme/acme/apps/stats_updater/stats_updater.py", line 94, in
> run
>
> result = StatisticsService.get().increment_counters(cookie, counter_type,
> obj_id, pdate, 1, tag_name)
>
> File
> "/opt/acme/local/lib/python2.7/site-packages/s1audservice/statistics_service.py",
> line 41, in increment_counters
>
> self.do_increment_counter(False, FrequencyCriteria.HOUR,
> counter_type_tag, obj_id, date, value)
>
> File
> "/opt/acme/local/lib/python2.7/site-packages/s1audservice/statistics_service.py",
> line 389, in do_increment_counter
>
> return self.increment_counter(counter_type_tag, f_date, nosql_id,
> cf_to_update, value_to_increment)
>
> File
> "/opt/acme/local/lib/python2.7/site-packages/s1audservice/statistics_service.py",
> line 397, in increment_counter
>
> pycassa.ConsistencyLevel.ALL)
>
> File "/opt/acme/local/lib/python2.7/site-packages/pycassa/columnfamily.py",
> line 1066, in add
>
> allow_retries=self._allow_retries)
>
> File "/opt/acme/local/lib/python2.7/site-packages/pycassa/pool.py", line
> 577, in execute
>
> return getattr(conn, f)(*args, **kwargs)
>
> File "/opt/acme/local/lib/python2.7/site-packages/pycassa/pool.py", line
> 148, in new_f
>
> (self._retry_count, exc.__class__.__name__, exc))
> MaximumRetryException: Retried 1 times. Last failure was EOFError:
>
> I'm using DataStax Enterprise version 3.2.2-1, with cassandra 1.2.12.2.
> my application is written in python 2.7 and connects cassandra through
> pycassa 1.10.0, my thrift version is 0.9.1
>
> here is the code that connects cassandra:
>
>
> __instances = {}
> __CONNECTION_POOL_SIZE_PER_HOST = 20
>
> def __init__(self, prefix):
> if not prefix:
> raise ValueError ("Invalid prefix for connection")
>
> self.ip_seeds = ConfigService.get().get_property(prefix + ".host") +
> ":"\
> + ConfigService.get().get_property(prefix + ".port")
> self.cluster_name = ConfigService.get().get_property(prefix +
> ".cluster_name")
> self.keyspace_name = ConfigService.get().get_property(prefix +
> ".keyspace")
> self.conec_pool_name = ConfigService.get().get_property(prefix +
> ".pool_name")
> self.con_pool = pycassa.ConnectionPool(self.keyspace_name,
> server_list=[self.ip_seeds], timeout=50)
>
>
>
> this is the code that triggers the exception:
>
> cf_to_update.add(
> (counter_type_tag, long(str_date_formatted)),
> nosql_id,
> int(value),
> None,
> pycassa.ConsistencyLevel.ALL)
>
>
>
> This same code is running successfully without any errors with a single
> node cassandra cluster and very close configurations:
> python 2.7 apache cassandra 1.2.8, pycassa 1.10.0, thrift 0.9.1
>
> any help would be greatly appreciated.
>
--
Tyler Hobbs
DataStax <http://datastax.com/>
