My index is growing by 1 million records per day. How much memory do i need
to increase.
What kind of sorting algorithm being used in Lucene. Is this efficient
enough to handle millions of records.
Whether we could do sorting using our own algorithm?
Regards
Ganesh
----- Original Message -----
From: "Fuad Efendi" <[EMAIL PROTECTED]>
To: <java-user@lucene.apache.org>
Sent: Wednesday, September 17, 2008 7:28 PM
Subject: Re: Exception while doing sorting
Increase memory.
Lucene uses FieldCache for sorting on non-tokenized field and tries to
maintain fields from all your 4 millions documents, even if you need
to sort only 4000 docs.
==============
http://www.tokenizer.org/bot.html
Quoting Ganesh - yahoo <[EMAIL PROTECTED]>:
Hello all,
I am have indexed more than 4 million documents. My query fetches
300,000 hits. If i perform sorting on any field, then tomcat reports
out of memory exception.
Sometimes the query results may be around 1000, but sorting on any
field might take more than 30 - 50 secs.
I don't know what's going wrong.
My index searcher is static object and it is getting refreshed every
minute. JSP pages directly calls the index searcher object and performs
search.
Regards
Ganesh
Send instant messages to your online friends
http://in.messenger.yahoo.com
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
Send instant messages to your online friends http://in.messenger.yahoo.com
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
