RE: compaction throughput rate not even close to 16MB

2013-04-25 Thread Viktor Jevdokimov
: Hiller, Dean [mailto:dean.hil...@nrel.gov] Sent: Wednesday, April 24, 2013 23:38 To: user@cassandra.apache.org Subject: Re: compaction throughput rate not even close to 16MB Thanks much!!! Better to hear at least one other person sees the same thing ;). Sometimes these posts just go silent

compaction throughput rate not even close to 16MB

2013-04-24 Thread Hiller, Dean
I was wondering about the compactionthroughput. I never see ours get even close to 16MB and I thought this is supposed to throttle compaction, right? Ours is constantly less than 3MB/sec from looking at our logs or do I have this totally wrong? How can I see the real throughput so that I can

Re: compaction throughput rate not even close to 16MB

2013-04-24 Thread Edward Capriolo
I have noticed the same. I think in the real world your compaction throughput is limited by other things. If I had to speculate I would say that compaction can remove expired tombstones, however doing this requires bloom filter checks, etc. I think that setting is more important with multi

Re: compaction throughput rate not even close to 16MB

2013-04-24 Thread Robert Coli
On Wed, Apr 24, 2013 at 1:33 PM, Edward Capriolo edlinuxg...@gmail.com wrote: I think that setting is more important with multi threaded compaction and/or more compaction slots. In those cases it may actually throttle something. Or if you're simultaneously doing a repair, which does a

Re: compaction throughput rate not even close to 16MB

2013-04-24 Thread Hiller, Dean
@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Wednesday, April 24, 2013 2:33 PM To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: compaction throughput rate not even close to 16MB I have noticed the same. I think in the real

Re: compaction throughput rate not even close to 16MB

2013-04-24 Thread Wei Zhu
, we are on SSD. -Wei From: Hiller, Dean dean.hil...@nrel.gov To: user@cassandra.apache.org user@cassandra.apache.org Sent: Wednesday, April 24, 2013 1:37 PM Subject: Re: compaction throughput rate not even close to 16MB Thanks much!!!  Better to hear at least