Re: how to delete data with level compaction

2012-01-28 Thread Peter Schuller
I'm using level compaction and I have about 200GB compressed in my largest CFs. The disks are getting full. This is time-series data so I want to drop data that is a couple of months old. It's pretty easy for me to iterate through the relevant keys and delete the rows. But will that do

Re: how to delete data with level compaction

2012-01-28 Thread Thorsten von Eicken
On 1/28/2012 9:34 AM, Peter Schuller wrote: I'm using level compaction and I have about 200GB compressed in my largest CFs. The disks are getting full. This is time-series data so I want to drop data that is a couple of months old. It's pretty easy for me to iterate through the relevant keys

Re: how to delete data with level compaction

2012-01-28 Thread Peter Schuller
I'm at 80%, so not quite panic yet ;-) I'm wondering, in the steady state, how much of the space used will contain deleted data. That depends entirely on your workload, including: * How big the data that you are deleting is in relation to the size of tombstones * How long the average piece

how to delete data with level compaction

2012-01-27 Thread Thorsten von Eicken
I'm using level compaction and I have about 200GB compressed in my largest CFs. The disks are getting full. This is time-series data so I want to drop data that is a couple of months old. It's pretty easy for me to iterate through the relevant keys and delete the rows. But will that do anything? I

Re: how to delete data

2010-03-25 Thread Jonathan Ellis
Commented on the Jira issue. Curious how badly out of date that patch is now. :) On Wed, Mar 24, 2010 at 12:55 PM, Ran Tavory ran...@gmail.com wrote: I'm willing to give it a try. Where do I start, except for applying the patch in the bug? On Wed, Mar 24, 2010 at 2:30 PM, Jonathan Ellis

how to delete data

2010-03-24 Thread Ran Tavory
What's the recommended way to delete data? For example, I want to wipe out an entire column family data from disk with minimal effort. I could: 1. stop all hosts in the cluster 2. restart them until they finish playing commit logs 3. stop them again 4. delete all CF related files in

Re: how to delete data

2010-03-24 Thread Scott White
Not that this is much better, but can't you replace steps 1-2 with nodeprobe -flush ? On Wed, Mar 24, 2010 at 2:03 AM, Ran Tavory ran...@gmail.com wrote: What's the recommended way to delete data? For example, I want to wipe out an entire column family data from disk with minimal effort. I

Re: how to delete data

2010-03-24 Thread Ran Tavory
I'm willing to give it a try. Where do I start, except for applying the patch in the bug? On Wed, Mar 24, 2010 at 2:30 PM, Jonathan Ellis jbel...@gmail.com wrote: Currently there is no good way to do this. We're planning to add truncate support in