AW: NewBie To Lucene || Perfect configuration on a 64 bit server

2014-05-27 Thread Ralf Heyde
Hey, I have several notes about your process. 1st: How you select the documents you are passing to the index for further searching? Maybe it is more straight forward to "find" them on you programming language? 2nd: Storage is cheap, buy a hard-disk and store the overall index. The most expensive

RE: NewBie To Lucene || Perfect configuration on a 64 bit server

2014-05-27 Thread Shruthi
Hi Eric, Here are a few statistics we got lately. It takes 11 secs on a 64 bit server using RAMDirectory impl for 500 RTF documents to get indexed on the fly. It takes 25 seconds for the same scenario if each of the RTF is converted to text file using Aspose and then indexing the text files. We

Re: fadvise/madvise during segment-merges....

2014-05-27 Thread Ravikumar Govindarajan
Sorry for the wrong info. I can only trace the code allocating twice the pages for SEQUENTIAL. I can't trace the code that discards the allocated pages... AFAIK, there are 2 options if discard doesn't happen automatically 1. SEQUENTIAL + NOREUSE This can be issued as a single-call, but I thin