I see you have a 64-bit OS but 32-bit JVM. Have you tried a 64-bit JVM (with
a bigger RAM buffer)?
Peter
On 7/13/07, eks dev <[EMAIL PROTECTED]> wrote:
>Interesting. This matches the experience Doron had where adding more
>RAM actually slowed things down a bit (posted to
>LUCENE-843).
I know this intrigues you, so our fresh experience:
The bigger the RAM Buffer the faster indexing, this holds until you hit
some limit that starts irritating gc(). But this limit is somehow "natural"
and is given by the environment (available RAM, competing OS File cache and
who knows what else)... basically , we concluded after testing the more
memory, more speed is to expect (this is kind of ideal scaling, one proof
more of the algorithmic strength).
This test showed 110k Docs/second at 32Mb (what we found to be optimal for
our needs, as it slowly speeds-up after that to 123k Docs/sec at 256Mb)
I suspect this phenomena on our last test and what Doron mentioned was due
to the wrong maxBufferedDocs. Have no other explanation
Basically, we achieved almost 20 X speed-up by just having LUCEN-843 and
your valuable comments on how to utilize this nice machine called Lucene.
___________________________________________________________
Yahoo! Mail is the world's favourite email. Don't settle for less, sign up
for
your free account today
http://uk.rd.yahoo.com/evt=44106/*http://uk.docs.yahoo.com/mail/winter07.html
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
