Re: hector timeouts

2012-07-02 Thread Deno Vichas
is anybody using kafka? what other options is there? currently i need to do around 50,000 (is that a lot?) a minute. On 7/1/2012 11:39 AM, aaron morton wrote: Using Cassandra as a queue is generally thought of as a bas idea, owing to the high delete workload. Levelled compaction handles it

Re: hector timeouts

2012-07-02 Thread Joe Stein
lots of folks use Apache Kafka, check out https://cwiki.apache.org/confluence/display/KAFKA/Powered+By just to name a few you can read about the performance for yourself http://incubator.apache.org/kafka/performance.html @ http://www.medialets.com we use Kafka upstream of Cassandra acting like a

Re: hector timeouts

2012-07-01 Thread aaron morton
Using Cassandra as a queue is generally thought of as a bas idea, owing to the high delete workload. Levelled compaction handles it better but it is still no the best approach. Depending on your needs consider running http://incubator.apache.org/kafka/ could you share some details on this?

Re: hector timeouts

2012-06-28 Thread Deno Vichas
On 6/28/2012 9:37 AM, David Leimbach wrote: That coupled with Hector timeout issues became a real problem for us. could you share some details on this? we're using hector and we see random timeout warns in the logs and not sure how to address them. thanks, deno