Disk usage after document deletion

2009-01-25 Thread James Brady
Hi,I have a number of indices that are supposed to maintaining windows of indexed content - the last month's work of data, for example. At the moment, I'm cleaning out old documents with a simple cron job making requests like: deletequerydate_added:[* TO NOW-30DAYS]/query/delete I was expecting

Re: Disk usage after document deletion

2009-01-25 Thread Ryan McKinley
On Jan 25, 2009, at 6:06 PM, James Brady wrote: Hi,I have a number of indices that are supposed to maintaining windows of indexed content - the last month's work of data, for example. At the moment, I'm cleaning out old documents with a simple cron job making requests like:

Re: Disk usage after document deletion

2009-01-25 Thread James Brady
The number of documents varies - sometimes it increases, sometimes it decreases - month to month. However, the index size increases monotonically. I was expecting some gradual growth as I expect Lucene retains terms that are no longer referenced from any documents, so you'll end up with the