Have a look at http://wiki.apache.org/lucene-java/BasicsOfPerformance
Your times sound pretty high, but it depends on the complexity of the
query, etc. Can you share information about your queries, etc.? Are
you opening the IndexSearcher on every query?
-Grant
On Feb 3, 2008, at 12:24 PM, phiras wrote:
Hi,
We have a single Lucene index consist of 4.5 million document with 20
million different term.
The lookup time is too high , (more than 3 seconds) for a none-simple
boolean query, this high lookup time is not acceptable.
We did a simple test to figure out the relation between ( documents
count &
lookup time ) and the results was amazing.
note : queries and documents are generated randomly
Doc count / lookup time for 1000 multi term query ( in
milliseconds )
5000 / 1683
10000 / 2898
15000 / 23667
20000 / 25002
25000 / 31282
30000 / 43849
35000 / 53526
40000 / 69321
45000 / 73319
50000 / 80006
My questions now are :
1- What's the search complexity in Lucene (driven by what ?).
2- How can we enhance search performance ?
Thank you.
--------------------------------------------------
Firas Kassem,
d1g corp.
--
View this message in context:
http://www.nabble.com/high-lookup-time-on-single-lucene-index-tp15255763p15255763.html
Sent from the Lucene - Java Developer mailing list archive at
Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
--------------------------
Grant Ingersoll
http://lucene.grantingersoll.com
http://www.lucenebootcamp.com
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
