Re: About the heap

2013-03-18 Thread aaron morton
- From: Wei Zhu wz1...@yahoo.com To: user@cassandra.apache.org Sent: Wednesday, March 13, 2013 11:35:29 AM Subject: Re: About the heap Hi Dean, The index_interval is controlling the sampling of the SSTable to speed up the lookup of the keys in the SSTable. Here is the code: https

Re: About the heap

2013-03-14 Thread aaron morton
the ancestor. https://issues.apache.org/jira/browse/CASSANDRA-5342 -Wei - Original Message - From: Wei Zhu wz1...@yahoo.com To: user@cassandra.apache.org Sent: Wednesday, March 13, 2013 11:35:29 AM Subject: Re: About the heap Hi Dean, The index_interval is controlling

Re: About the heap

2013-03-14 Thread Alain RODRIGUEZ
To: user@cassandra.apache.org Sent: Wednesday, March 13, 2013 11:35:29 AM Subject: Re: About the heap Hi Dean, The index_interval is controlling the sampling of the SSTable to speed up the lookup of the keys in the SSTable. Here is the code: https://github.com/apache/cassandra/blob/trunk/src

Re: About the heap

2013-03-14 Thread Michael Theroux
. https://issues.apache.org/jira/browse/CASSANDRA-5342 -Wei - Original Message - From: Wei Zhu wz1...@yahoo.com To: user@cassandra.apache.org Sent: Wednesday, March 13, 2013 11:35:29 AM Subject: Re: About the heap Hi Dean, The index_interval is controlling the sampling

Re: About the heap

2013-03-13 Thread Hiller, Dean
Going to 1.2.2 helped us quite a bit as well as turning on LCS from STCS which gave us smaller bloomfilters. As far as key cache. There is an entry in cassandra.yaml called index_interval set to 128. I am not sure if that is related to key_cache. I think it is. By turning that to 512 or

Re: About the heap

2013-03-13 Thread Alain RODRIGUEZ
called index_interval set to 128 I think this is for BloomFilters actually. 2013/3/13 Hiller, Dean dean.hil...@nrel.gov Going to 1.2.2 helped us quite a bit as well as turning on LCS from STCS which gave us smaller bloomfilters. As far as key cache. There is an entry in cassandra.yaml

Re: About the heap

2013-03-13 Thread Wei Zhu
/SSTableMetadata.java#L58 Enjoy looking at Cassandra code:) -Wei - Original Message - From: Dean Hiller dean.hil...@nrel.gov To: user@cassandra.apache.org Sent: Wednesday, March 13, 2013 11:11:14 AM Subject: Re: About the heap Going to 1.2.2 helped us quite a bit as well as turning on LCS from STCS

Re: About the heap

2013-03-13 Thread Alain RODRIGUEZ
You can trigger minor compaction on an individual SStable file when the percentage of tombstones in that Sstable crosses a user-defined threshold. We have just one cf with TTL. I don't think the problem comes from there. Peaks may be occurring during compaction, when Sstable files are memmapped.

Re: About the heap

2013-03-13 Thread Wei Zhu
- Original Message - From: Alain RODRIGUEZ arodr...@gmail.com To: user@cassandra.apache.org Sent: Wednesday, March 13, 2013 11:28:28 AM Subject: Re: About the heap called index_interval set to 128 I think this is for BloomFilters actually. 2013/3/13 Hiller, Dean dean.hil...@nrel.gov

Re: About the heap

2013-03-13 Thread Wei Zhu
Here is the JIRA I submitted regarding the ancestor. https://issues.apache.org/jira/browse/CASSANDRA-5342 -Wei - Original Message - From: Wei Zhu wz1...@yahoo.com To: user@cassandra.apache.org Sent: Wednesday, March 13, 2013 11:35:29 AM Subject: Re: About the heap Hi Dean