I'm using level compaction and I have about 200GB compressed in my
largest CFs. The disks are getting full. This is time-series data so I
want to drop data that is a couple of months old. It's pretty easy for
me to iterate through the relevant keys and delete the rows. But will
that do
On 1/28/2012 9:34 AM, Peter Schuller wrote:
I'm using level compaction and I have about 200GB compressed in my
largest CFs. The disks are getting full. This is time-series data so I
want to drop data that is a couple of months old. It's pretty easy for
me to iterate through the relevant keys
I'm at 80%, so not quite panic yet ;-)
I'm wondering, in the steady state, how much of the space used will
contain deleted data.
That depends entirely on your workload, including:
* How big the data that you are deleting is in relation to the size of
tombstones
* How long the average piece
I'm using level compaction and I have about 200GB compressed in my
largest CFs. The disks are getting full. This is time-series data so I
want to drop data that is a couple of months old. It's pretty easy for
me to iterate through the relevant keys and delete the rows. But will
that do anything?
I
Commented on the Jira issue.
Curious how badly out of date that patch is now. :)
On Wed, Mar 24, 2010 at 12:55 PM, Ran Tavory ran...@gmail.com wrote:
I'm willing to give it a try.
Where do I start, except for applying the patch in the bug?
On Wed, Mar 24, 2010 at 2:30 PM, Jonathan Ellis
What's the recommended way to delete data?
For example, I want to wipe out an entire column family data from disk with
minimal effort.
I could:
1. stop all hosts in the cluster
2. restart them until they finish playing commit logs
3. stop them again
4. delete all CF related files in
Not that this is much better, but can't you replace steps 1-2 with nodeprobe
-flush ?
On Wed, Mar 24, 2010 at 2:03 AM, Ran Tavory ran...@gmail.com wrote:
What's the recommended way to delete data?
For example, I want to wipe out an entire column family data from disk with
minimal effort.
I
I'm willing to give it a try.
Where do I start, except for applying the patch in the bug?
On Wed, Mar 24, 2010 at 2:30 PM, Jonathan Ellis jbel...@gmail.com wrote:
Currently there is no good way to do this. We're planning to add
truncate support in