Re: Batch writes getting slow

2011-10-07 Thread Stefan Reek
Is it actually filling up enough to trigger an old-gen CMS gc? Yes, it fills up to the 16G and then it starts doing the CMS gc's which dramatically decreases the performance. I'm still not sure why it does this, as a nodetool info states the load as less than 4G. Any ideas? On 10/06/2011

Re: Batch writes getting slow

2011-10-07 Thread Jonathan Ellis
Look at the OOM section in http://www.datastax.com/docs/0.6/troubleshooting/index On Fri, Oct 7, 2011 at 3:47 AM, Stefan Reek ste...@unitedgames.com wrote: Is it actually filling up enough to trigger an old-gen CMS gc? Yes, it fills up to the 16G and then it starts doing the CMS gc's which

Batch writes getting slow

2011-10-06 Thread Stefan Reek
Hi guys, We're currently testing an application against a very high load, which runs against Cassandra 0.6.13 (I know, we just never got the time to upgrade). The nature of our app is that it will write to two different SuperColumnFamilies in bursts, and to some other columnfamilies less

Re: Batch writes getting slow

2011-10-06 Thread Jonathan Ellis
On Thu, Oct 6, 2011 at 10:09 AM, Stefan Reek ste...@unitedgames.com wrote: I can see that during the times the writing gets slow there are ~3000 pending tasks, but they disappear quickly. Your best bet is to make the write load more constant and less bursty. If you really do need to handle

Re: Batch writes getting slow

2011-10-06 Thread Stefan Reek
On 10/06/2011 05:26 PM, Jonathan Ellis wrote: On Thu, Oct 6, 2011 at 10:09 AM, Stefan Reekste...@unitedgames.com wrote: I can see that during the times the writing gets slow there are ~3000 pending tasks, but they disappear quickly. Your best bet is to make the write load more

Re: Batch writes getting slow

2011-10-06 Thread Jonathan Ellis
On Thu, Oct 6, 2011 at 10:53 AM, Stefan Reek ste...@unitedgames.com wrote: We do have the commitlogs on separate devices, are there any other basics that I could have forgotten, or any parameters that are important for write performance? 1.0 write performance is something like 30% better... I