Re: nodetool repair caused high disk space usage

2011-08-22 Thread Huy Le
and under what circumstances they got written? -- / Peter Schuller (@scode on twitter) -- Huy Le Spring Partners, Inc. http://springpadit.com

Re: nodetool repair caused high disk space usage

2011-08-19 Thread Huy Le
unexpected). Do you have any old left-over streams active on the nodes? nodetool netstats. If there are stuck streams, they might be causing sstable retention beyond what you'd expect. -- / Peter Schuller (@scode on twitter) -- Huy Le Spring Partners, Inc. http://springpadit.com

Re: nodetool repair caused high disk space usage

2011-08-19 Thread Huy Le
from source node is supposed to be streamed destination node? I'm just wildly speculation, but it would be nice to get to the bottom of this. -- / Peter Schuller (@scode on twitter) -- Huy Le Spring Partners, Inc. http://springpadit.com

Re: nodetool repair caused high disk space usage

2011-08-18 Thread Huy Le
compactions because it appears that Validation are not constrained by it. That way, I would have fewer concurrent compactions are the disk would not fill up (as fast?) 2011/8/17 Huy Le hu...@springpartners.com I restarted the cluster and kicked off repair on the same node again. It only made

Re: nodetool repair caused high disk space usage

2011-08-18 Thread Huy Le
? Huy On Thu, Aug 18, 2011 at 10:22 AM, Philippe watche...@gmail.com wrote: Unfortunately repairing one cf at a time didn't help in my case because it still streams all CF and that triggers lots of compactions On Aug 18, 2011 3:48 PM, Huy Le hu...@springpartners.com wrote: -- Huy Le

nodetool repair caused high disk space usage

2011-08-17 Thread Huy Le
this issue? Huy -- Huy Le Spring Partners, Inc. http://springpadit.com

Re: nodetool repair caused high disk space usage

2011-08-17 Thread Huy Le
a problem. Does anyone have any further info on the issue? Thanks! Huy On Wed, Aug 17, 2011 at 11:13 AM, Huy Le hu...@springpartners.com wrote: Sorry for the duplicate thread. I saw the issue being referenced to https://issues.apache.org/jira/browse/CASSANDRA-2280. However, I am running

Re: nodetool repair on cluster

2011-03-17 Thread Huy Le
/Operations#Repairing_missing_or_inconsistent_data Aaron On 16 Mar 2011, at 06:58, Daniel Doubleday wrote: At least if you are using RackUnawareStrategy Cheers, Daniel On Mar 15, 2011, at 6:44 PM, Huy Le wrote: Hi, We have a cluster with 12 servers and use RF=3. When running nodetool

nodetool repair on cluster

2011-03-15 Thread Huy Le
Hi, We have a cluster with 12 servers and use RF=3. When running nodetool repair, do we have to run it on all nodes on the cluster or can we run on every 3rd node? Thanks! Huy -- Huy Le Spring Partners, Inc. http://springpadit.com

Re: Out of control memory consumption

2011-02-10 Thread Huy Le
Yes, we had setting at 75 but JVM did not have enough time to do GC, so it abort GC'ing. We lowered it to 50, but still had issue, so we lowered it again to 35. On Thu, Feb 10, 2011 at 12:11 PM, Oleg Anastasyev olega...@gmail.comwrote: Huy Le huyle at springpartners.com writes: Our CMS

Out of control memory consumption

2011-02-09 Thread Huy Le
Hi, There is already an email thread on memory issue on this email list, but I creating a new thread as we are experiencing a different memory consumption issue. We are 12-server cluster. We use random partitioner with manually generated server tokens. Memory usage on one server keeps growing

Re: Out of control memory consumption

2011-02-09 Thread Huy Le
-heap memory usage is 138MB. Any recommendation where should look to see why memory usage keep growing? Thanks! Huy Are you using standard, mmap_index_only, or mmap io? Are you using JNA? We use standard disk access mode with JNA. Huy -- Huy Le Spring Partners, Inc. http

Re: Out of control memory consumption

2011-02-09 Thread Huy Le
your 500 mb is the report of the actual live data set as evidenced by post-CMS heap usage. What's considered to be live data? If we clear caches, run flush on the key space, shouldn't that free up memory? Thanks! Huy -- / Peter Schuller -- Huy Le Spring Partners, Inc. http