Re: Best strategy for reindexing large amount of data

2009-10-08 Thread Maarten_D
> (including what's recently been deleted). > > Does that make sense? > > -jake > > On Wed, Oct 7, 2009 at 2:30 PM, Maarten_D > wrote: > >> >> Hi Jake, >> Thanks for your answer. I hadn't realised that doing the updates in >> r

Re: Best strategy for reindexing large amount of data

2009-10-07 Thread Maarten_D
eeded. Also you can simply update in place the existing >> documents in the index, though you'd need to be careful not to >> overload the server with indexing calls such that queries would >> not be responsive. Number 3 (batches) could be used to create an >> index on the

Best strategy for reindexing large amount of data

2009-10-07 Thread Maarten_D
Hi, I've searched the mailinglists and documentation for a clear answer to the following question, but haven't found one, so here goes: We use Lucene to index and search a constant stream of messages: our index is always growing. In the past, if we added new features to the software that required