Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-14 Thread J. Ryan Earl
First off, I'm curious what hardware (system specs) you're running this on? Secondly, here are some observations: * You're not running the newest JDK7, I can tell by your stack-size. Consider getting the newest. * Cassandra 2.0.2 has a lot of improvements, consider upgrading. We noticed

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-14 Thread Robert Coli
On Thu, Nov 14, 2013 at 10:05 AM, J. Ryan Earl o...@jryanearl.us wrote: * Cassandra 2.0.2 has a lot of improvements, consider upgrading. We noticed improved heap usage compared to 2.0.2 https://engineering.eventbrite.com/what-version-of-cassandra-should-i-run/ And especially if you're using

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-12 Thread Jiri Horky
Hi, On 11/12/2013 05:29 AM, Aaron Morton wrote: Are you doing large slices or do could you have a lot of tombstones on the rows ? don't really know - how can I monitor that? For tombstones, do you do a lot of deletes ? Also in v2.0.2 cfstats has this Average live cells per slice (last

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-11 Thread Aaron Morton
Are you doing large slices or do could you have a lot of tombstones on the rows ? don't really know - how can I monitor that? For tombstones, do you do a lot of deletes ? Also in v2.0.2 cfstats has this Average live cells per slice (last five minutes): 0.0

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-08 Thread Jiri Horky
Hi, On 11/07/2013 05:18 AM, Aaron Morton wrote: Class Name | Shallow Heap | Retained Heap

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-07 Thread Chris Burroughs
On 11/06/2013 11:18 PM, Aaron Morton wrote: The default row cache is of the JVM heap, have you changed to the ConcurrentLinkedHashCacheProvider ? ConcurrentLinkedHashCacheProvider was removed in 2.0.x.

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-06 Thread Chris Burroughs
Both caches involve several objects per entry (What do we want? Packed objects. When do we want them? Now!). The size is an estimate of the off heap values only and not the total size nor number of entries. An acceptable size will depend on your data and access patterns. In one case we

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-06 Thread Aaron Morton
Class Name | Shallow Heap | Retained Heap ---

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-05 Thread Sávio Teles
We have the same problem. 2013/11/5 Jiri Horky ho...@avast.com Hi there, we are seeing extensive memory allocation leading to quite long and frequent GC pauses when using row cache. This is on cassandra 2.0.0 cluster with JNA 4.0 library with following settings: key_cache_size_in_mb: 300