Re: Would warnings about overlapping SStables explain high pending compactions?

2014-09-25 Thread Marcus Eriksson
Not really What version are you on? Do you have pending compactions and no ongoing compactions? /Marcus On Wed, Sep 24, 2014 at 11:35 PM, Donald Smith donald.sm...@audiencescience.com wrote: On one of our nodes we have lots of pending compactions (499).In the past we’ve seen pending

RE: Would warnings about overlapping SStables explain high pending compactions?

2014-09-25 Thread Donald Smith
Version 2.0.9. We have 11 ongoing compactions on that node. From: Marcus Eriksson [mailto:krum...@gmail.com] Sent: Thursday, September 25, 2014 12:45 AM To: user@cassandra.apache.org Subject: Re: Would warnings about overlapping SStables explain high pending compactions? Not really What

Would warnings about overlapping SStables explain high pending compactions?

2014-09-24 Thread Donald Smith
On one of our nodes we have lots of pending compactions (499).In the past we've seen pending compactions go up to 2400 and all the way back down again. Investigating, I saw warnings such as the following in the logs about overlapping SStables and about needing to run nodetool scrub on a

Re: high pending compactions

2014-07-15 Thread Chris Lohfink
...@blackbirdit.com Subject: Re: high pending compactions Date: Mon, 9 Jun 2014 14:11:36 -0500 To: user@cassandra.apache.org Bean: org.apache.cassandra.db.CompactionManager also nodetool compactionstats gives you how many are in the queue + estimate of how many will be needed. in 1.1 you will OOM far

Re: high pending compactions

2014-07-14 Thread Greg Bone
PM, S C as...@outlook.com wrote: Thank you all for quick responses. -- From: clohf...@blackbirdit.com Subject: Re: high pending compactions Date: Mon, 9 Jun 2014 14:11:36 -0500 To: user@cassandra.apache.org Bean: org.apache.cassandra.db.CompactionManager also

Re: high pending compactions

2014-06-09 Thread Colin Kuo
As Jake suggested, you could firstly increase compaction_throughput_mb_per_sec and concurrent_compactions to suitable values if system resource is allowed. From my understanding, major compaction will internally acquire lock before running compaction. In your case, there might be a major

RE: high pending compactions

2014-06-09 Thread S C
Thank you all for valuable suggestions. Couple more questions, How to check the compaction queue? MBean/C* system log ?What happens if the queue is full? From: colinkuo...@gmail.com Date: Mon, 9 Jun 2014 18:53:41 +0800 Subject: Re: high pending compactions To: user@cassandra.apache.org As Jake

Re: high pending compactions

2014-06-09 Thread Chris Lohfink
Date: Mon, 9 Jun 2014 18:53:41 +0800 Subject: Re: high pending compactions To: user@cassandra.apache.org As Jake suggested, you could firstly increase compaction_throughput_mb_per_sec and concurrent_compactions to suitable values if system resource is allowed. From my understanding, major

RE: high pending compactions

2014-06-09 Thread S C
Thank you all for quick responses. From: clohf...@blackbirdit.com Subject: Re: high pending compactions Date: Mon, 9 Jun 2014 14:11:36 -0500 To: user@cassandra.apache.org Bean: org.apache.cassandra.db.CompactionManager also nodetool compactionstats gives you how many are in the queue + estimate

high pending compactions

2014-06-08 Thread S C
I am using Cassandra 1.1 (sorry bit old) and I am seeing high pending compaction count. pending tasks: 67 while active compaction tasks are not more than 5. I have a 24CPU machine. Shouldn't I be seeing more compactions? Is this a pattern of high writes and compactions backing up? How can I

Re: high pending compactions

2014-06-08 Thread Jake Luciani
23 On Sunday, June 8, 2014, S C as...@outlook.com wrote: I am using Cassandra 1.1 (sorry bit old) and I am seeing high pending compaction count. pending tasks: 67 while active compaction tasks are not more than 5. I have a 24CPU machine. Shouldn't I be seeing more compactions? Is this a

Re: high pending compactions

2014-06-08 Thread William Katsak
Have you verified that these aren't stuck compactions? e.g. even under no load, they don't go away? -Bill On 06/08/2014 12:32 PM, Jake Luciani wrote: 23 On Sunday, June 8, 2014, S C as...@outlook.com mailto:as...@outlook.com wrote: I am using Cassandra 1.1 (sorry bit old) and I am

RE: high pending compactions

2014-06-08 Thread S C
How to check if there are any stuck compactions? Date: Sun, 8 Jun 2014 12:43:45 -0400 From: wkat...@cs.rutgers.edu To: user@cassandra.apache.org Subject: Re: high pending compactions Have you verified that these aren't stuck compactions? e.g. even under no load, they don't go away