I have 512MB RAM allocated to JVM Heap. If I double my system RAM from 768MB to say 2GB or so, and give JVM 1.5GB Heap space, will I get quicker results ?
Can I expect results which take 1 minute to be returned in 30 seconds with more RAM ? Should I also get a more powerful CPU ? A real server class machine ? I have also done some of the optimizations that are mentioned on the Lucene website. thanks, AZ On 7/24/07, Askar Zaidi <[EMAIL PROTECTED]> wrote: > > Hey Guys, > > I just finished up using Lucene in my application. I have data in a > database , so while indexing I extract this data from the database and pump > it into the index. Specifically , I have the following data in the index: > > <itemID> <tags> <title> <summary> <contents> > > where itemID is just a number (primary key in the DB) > tags : text > titie: text > summary: text > contents: Huge text (text extracted from files: pdfs, docs etc). > > Now while running a search query I realized that the response time > increases in a linear fashion as the number of <itemID> increase in the DB. > > If I have 50 items, its 8 seconds > 100 items, its 17 seconds. > 300+ items, its 60 seconds and maybe more. > > In a perfect world, I'd like to search on 300+ items within 10-15 seconds. > Can anyone give me tips to fine tune lucene ? > > Heres a code snippet: > > sql query = "SELECT itemID from items where creator = 'askar' ; > > --execute query-- > > while(rs.next()){ > > score = doTagSearch(askar,text,itemID); > scoreTitle = doTitleSearch(askar,text,itemID); > scoreSummary = doSummarySearch(askar,text,itemID); > > ---- > > } > > So this code asks Lucene to search for the "text" in the itemID passed. > itemID is already indexed. The while loop will run 300 times if there are > 300 items....that gets slow...what can I do here ?? > > thanks for the replies, > > AZ >