if you are only indexing once, it's so important the index performance?
Every case is different, and in your case, with big documents and maybe small memory could be better to have a small merge factor. Try out and find the better parameter for your case, you have get some clues to optimize it using stop words and watching the memory usage. If you wan't to optimize it more, try to profile the code and the memory to watch what are the bottleneck in your case -- Jokin On 2/12/07, Sairaj Sunil <[EMAIL PROTECTED]> wrote:
Hi I saw that article and then only I thought I will speed up the performance. But increasing the merge factor for me is degrading the performance. I don't want to index periodically. I want to index all the documents just once. What is the best way to speed up the performance. I think i should mention that i am indexing only the local files on the local file system. Once the index is built, i just want to use the index. I tried increasing the SetMaxBufferedDocs also, but still the same result. The performance degrades. It slowed down the indexing process. I don't understand anything of this. On 2/12/07, Jokin Cuadrado <[EMAIL PROTECTED]> wrote: > > i think this link will help you: > http://www.onjava.com/pub/a/onjava/2003/03/05/lucene.html > > batch indexing is when you index in periodic basis, for example once a > day, and interactive is when you index "live" data. > > -- > Jokin > > > On 2/12/07, Sairaj Sunil <[EMAIL PROTECTED]> wrote: > > Hi > > I have not traced the memory usage. > > i have one question. what is the difference between batch indexing and > > interactive indexing. may be this is too silly to ask , but nevertheless > i > > want to make it clear. because if i reduce the merge factor below 10 > (for > > example 5), the performance has improved slightly. > > i am indexing the documents all at once. i.e., I open the writer and add > the > > documents in the end optimize and then close. > -- Sairaj Sunil II Mtech(CS) SSSIHL Prashanthi Nilayam
