Frequent updates lead to "Too many open files"

2011-01-08 Thread Andreas Harth
Hi, I have a single IndexWriter object which I use to update the index. After each update, I'd like to query the index using IndexReader and IndexSearcher objects. When I try to do that I get java.io.FileNotFoundException: /tmp/lucene/_32.fdx (Too many open files). lsof -p says that there are

Re: Frequent updates lead to "Too many open files"

2011-01-08 Thread Andreas Harth
Hi Ian, Ahmet, On 01/08/2011 06:13 PM, Ian Lea wrote: You also need to read the javadocs for reopen(), and the sample code there. And it would be worth reading up on lucene's near real-time (NRT) features. yep, that was it. reopen() behaves differently to what I'd expected. Using the IndexRe

Theoretical Lucene Performance

2006-05-16 Thread Andreas Harth
Hello, I'd like to learn a bit more about the index organization of Lucene (ideally without sifting through source code). Are there any publications that explain the Lucene indexing structure in detail? Or is it possible to say in a few sentences how Lucene works and I can look up the details in