Re: memtable mem usage off by 10?

2014-06-11 Thread Idrén , Johan
To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: memtable mem usage off by 10? In that case I would assume the problem is that for some reason JAMM is failing to load, and so the liveRatio it would ordinarily

Re: memtable mem usage off by 10?

2014-06-05 Thread Idrén , Johan
@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: memtable mem usage off by 10? In that case I would assume the problem is that for some reason JAMM is failing to load, and so the liveRatio it would ordinarily calculate is defaulting to 10 - are you using the bundled cassandra launch scripts

Re: memtable mem usage off by 10?

2014-06-05 Thread Benedict Elliott Smith
@cassandra.apache.org Subject: Re: memtable mem usage off by 10? In that case I would assume the problem is that for some reason JAMM is failing to load, and so the liveRatio it would ordinarily calculate is defaulting to 10 - are you using the bundled cassandra launch scripts? On 4 June 2014 15:51

Re: memtable mem usage off by 10?

2014-06-04 Thread Benedict Elliott Smith
If you are storing small values in your columns, the object overhead is very substantial. So what is 400Mb on disk may well be 4Gb in memtables, so if you are measuring the memtable size by the resulting sstable size, you are not getting an accurate picture. This overhead has been reduced by about

RE: memtable mem usage off by 10?

2014-06-04 Thread Idrén , Johan
Smith belliottsm...@datastax.com Sent: Wednesday, June 4, 2014 11:56 AM To: user@cassandra.apache.org Subject: Re: memtable mem usage off by 10? If you are storing small values in your columns, the object overhead is very substantial. So what is 400Mb on disk may well be 4Gb in memtables, so if you

Re: memtable mem usage off by 10?

2014-06-04 Thread Benedict Elliott Smith
*To:* user@cassandra.apache.org *Subject:* Re: memtable mem usage off by 10? If you are storing small values in your columns, the object overhead is very substantial. So what is 400Mb on disk may well be 4Gb in memtables, so if you are measuring the memtable size by the resulting sstable size, you

RE: memtable mem usage off by 10?

2014-06-04 Thread Idrén , Johan
From: Benedict Elliott Smith belliottsm...@datastax.com Sent: Wednesday, June 4, 2014 12:33 PM To: user@cassandra.apache.org Subject: Re: memtable mem usage off by 10? These measurements tell you the amount of user data stored in the memtables, not the amount of heap used to store it, so the same

Re: memtable mem usage off by 10?

2014-06-04 Thread Benedict Elliott Smith
-- *From:* Benedict Elliott Smith belliottsm...@datastax.com *Sent:* Wednesday, June 4, 2014 12:33 PM *To:* user@cassandra.apache.org *Subject:* Re: memtable mem usage off by 10? These measurements tell you the amount of user data stored in the memtables, not the amount of heap used

RE: memtable mem usage off by 10?

2014-06-04 Thread Idrén , Johan
, 2014 1:19 PM To: user@cassandra.apache.org Subject: Re: memtable mem usage off by 10? Unfortunately it looks like the heap utilisation of memtables was not exposed in earlier versions, because they only maintained an estimate. The overhead scales linearly with the amount of data in your memtables

Re: memtable mem usage off by 10?

2014-06-04 Thread Benedict Elliott Smith
respected. This shouldn't be possible. -- *From:* Benedict Elliott Smith belliottsm...@datastax.com *Sent:* Wednesday, June 4, 2014 1:19 PM *To:* user@cassandra.apache.org *Subject:* Re: memtable mem usage off by 10? Unfortunately it looks like the heap

RE: memtable mem usage off by 10?

2014-06-04 Thread Idrén , Johan
...@datastax.com Sent: Wednesday, June 4, 2014 2:07 PM To: user@cassandra.apache.org Subject: Re: memtable mem usage off by 10? I'm confused: there is no flush_largest_memtables_at property in C* 2.0? On 4 June 2014 12:55, Idrén, Johan johan.id...@dice.semailto:johan.id...@dice.se wrote: Ok, so

Re: memtable mem usage off by 10?

2014-06-04 Thread Jack Krupansky
:26 AM To: user@cassandra.apache.org Subject: RE: memtable mem usage off by 10? Oh, well ok that explains why I'm not seeing a flush at 750MB. Sorry, I was going by the documentation. It claims that the property is around in 2.0. If we skip that, part of my reply still makes sense: Having

Re: memtable mem usage off by 10?

2014-06-04 Thread Benedict Elliott Smith
/configCassandra_yaml_r.html And I don’t find a Jira issue mentioning it being removed, so... what’s the full story there?! -- Jack Krupansky *From:* Idrén, Johan johan.id...@dice.se *Sent:* Wednesday, June 4, 2014 8:26 AM *To:* user@cassandra.apache.org *Subject:* RE: memtable mem usage off by 10? Oh

Re: memtable mem usage off by 10?

2014-06-04 Thread Idrén , Johan
@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Wednesday 4 June 2014 16:36 To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: memtable mem usage off by 10? Oh, well ok that explains why I'm not seeing a flush

Re: memtable mem usage off by 10?

2014-06-04 Thread Jack Krupansky
And sorry that the doc confused you as well! -- Jack Krupansky From: Idrén, Johan Sent: Wednesday, June 4, 2014 10:51 AM To: user@cassandra.apache.org Subject: Re: memtable mem usage off by 10? I wasn’t supplying it, I was assuming it was using the default. It does not exist in my config

Re: memtable mem usage off by 10?

2014-06-04 Thread Benedict Elliott Smith
user@cassandra.apache.org Subject: Re: memtable mem usage off by 10? Oh, well ok that explains why I'm not seeing a flush at 750MB. Sorry, I was going by the documentation. It claims that the property is around in 2.0. But something else is wrong, as Cassandra will crash if you supply