RE: OutOfMemory example

2004-09-14 Thread Ji Kuhn
10:58 PM To: Lucene Users List Subject: Re: OutOfMemory example On Monday 13 September 2004 15:06, Ji Kuhn wrote: I think I can reproduce memory leaking problem while reopening an index. Lucene version tested is 1.4.1, version 1.4 final works OK. My JVM is: Could you try with the latest

Re: OutOfMemory example

2004-09-14 Thread Daniel Naber
On Tuesday 14 September 2004 08:32, Ji Kuhn wrote: The error is thrown in exactly the same point as before. This morning I downloaded Lucene from CVS, now the jar is lucene-1.5-rc1-dev.jar, JVM is 1.4.2_05-b04, both Linux and Windows. Now I can reproduce the problem. I first tried running the

Re: OutOfMemory example

2004-09-13 Thread John Moylan
You should reuse your old index (as eg an application variable) unless it has changed - use getCurrentVersion to check the index for updates. This has come up before. John Ji Kuhn wrote: Hi, I think I can reproduce memory leaking problem while reopening an index. Lucene version tested

RE: OutOfMemory example

2004-09-13 Thread Ji Kuhn
()); writer.close(); } ... -Original Message- From: John Moylan [mailto:[EMAIL PROTECTED] Sent: Monday, September 13, 2004 3:25 PM To: Lucene Users List Subject: Re: OutOfMemory example You should reuse your old index (as eg an application variable) unless it has changed - use

Re: OutOfMemory example

2004-09-13 Thread John Moylan
PROTECTED] Sent: Monday, September 13, 2004 3:25 PM To: Lucene Users List Subject: Re: OutOfMemory example You should reuse your old index (as eg an application variable) unless it has changed - use getCurrentVersion to check the index for updates. This has come up before. John

Re: OutOfMemory example

2004-09-13 Thread sergiu gordea
)); writer.addDocument(doc); System.err.println(index size: + writer.docCount()); writer.close(); } ... -Original Message- From: John Moylan [mailto:[EMAIL PROTECTED] Sent: Monday, September 13, 2004 3:25 PM To: Lucene Users List Subject: Re: OutOfMemory example You should reuse your

RE: OutOfMemory example

2004-09-13 Thread Ji Kuhn
: OutOfMemory example http://issues.apache.org/bugzilla/show_bug.cgi?id=30628 you can close the index, but the Garbage Collector still needs to reclaim the memory and it may be taking longer than your loop to do so. John

RE: OutOfMemory example

2004-09-13 Thread Ji Kuhn
To: Lucene Users List Subject: Re: OutOfMemory example I have a few comments regarding your code ... 1. Why do you use RamDirectory and not the hard disk? 2. as John said, you should reuse the index instead of creating it each time in the main function if(!indexExists(File indexFile

force gc idiom - Re: OutOfMemory example

2004-09-13 Thread David Spencer
: OutOfMemory example http://issues.apache.org/bugzilla/show_bug.cgi?id=30628 you can close the index, but the Garbage Collector still needs to reclaim the memory and it may be taking longer than your loop to do so. John

RE: force gc idiom - Re: OutOfMemory example

2004-09-13 Thread Ji Kuhn
To: Lucene Users List Subject: force gc idiom - Re: OutOfMemory example Ji Kuhn wrote: Thanks for the bug's id, it seems like my problem and I have a stand-alone code with main(). What about slow garbage collector? This looks for me as wrong suggestion. I've seen this written up before

Re: OutOfMemory example

2004-09-13 Thread sergiu gordea
and in deterministic way produce OutOfMemoryError. That's all. Jiri. -Original Message- From: sergiu gordea [mailto:[EMAIL PROTECTED] Sent: Monday, September 13, 2004 5:16 PM To: Lucene Users List Subject: Re: OutOfMemory example I have a few comments regarding your code ... 1. Why do you use

OptimizeIt -- Re: force gc idiom - Re: OutOfMemory example

2004-09-13 Thread David Spencer
that the code should run endlesly (I have said it before: in version 1.4 final it does). Jiri. -Original Message- From: David Spencer [mailto:[EMAIL PROTECTED] Sent: Monday, September 13, 2004 5:34 PM To: Lucene Users List Subject: force gc idiom - Re: OutOfMemory example Ji Kuhn wrote

FieldSortedHitQueue.Comparators -- Re: force gc idiom - Re: OutOfMemory example

2004-09-13 Thread David Spencer
it before: in version 1.4 final it does). Jiri. -Original Message- From: David Spencer [mailto:[EMAIL PROTECTED] Sent: Monday, September 13, 2004 5:34 PM To: Lucene Users List Subject: force gc idiom - Re: OutOfMemory example Ji Kuhn wrote: Thanks for the bug's id, it seems like my problem

Re: FieldSortedHitQueue.Comparators -- Re: force gc idiom - Re: OutOfMemory example

2004-09-13 Thread David Spencer
it does). Jiri. -Original Message- From: David Spencer [mailto:[EMAIL PROTECTED] Sent: Monday, September 13, 2004 5:34 PM To: Lucene Users List Subject: force gc idiom - Re: OutOfMemory example Ji Kuhn wrote: Thanks for the bug's id, it seems like my problem and I have a stand-alone code

SegmentReader - Re: FieldSortedHitQueue.Comparators -- Re: force gc idiom - Re: OutOfMemory example

2004-09-13 Thread David Spencer
have said it before: in version 1.4 final it does). Jiri. -Original Message- From: David Spencer [mailto:[EMAIL PROTECTED] Sent: Monday, September 13, 2004 5:34 PM To: Lucene Users List Subject: force gc idiom - Re: OutOfMemory example Ji Kuhn wrote: Thanks for the bug's id, it seems like

Re: OutOfMemory example

2004-09-13 Thread Daniel Naber
On Monday 13 September 2004 15:06, Ji Kuhn wrote: I think I can reproduce memory leaking problem while reopening an index. Lucene version tested is 1.4.1, version 1.4 final works OK. My JVM is: Could you try with the latest Lucene version from CVS? I cannot reproduce your problem with that

Re: OptimizeIt -- Re: force gc idiom - Re: OutOfMemory example

2004-09-13 Thread Kevin A. Burton
David Spencer wrote: Ji Kuhn wrote: This doesn't work either! You're right. I'm running under JDK1.5 and trying larger values for -Xmx and it still fails. Running under (Borlands) OptimzeIt shows the number of Terms and Terminfos (both in org.apache.lucene.index) increase every time thru the

Re: OutOfMemory example

2004-09-13 Thread Kevin A. Burton
Ji Kuhn wrote: Hi, I think I can reproduce memory leaking problem while reopening an index. Lucene version tested is 1.4.1, version 1.4 final works OK. My JVM is: $ java -version java version 1.4.2_05 Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_05-b04) Java HotSpot(TM)

Re: OutOfMemory example

2004-09-13 Thread David Spencer
Daniel Naber wrote: On Monday 13 September 2004 15:06, Ji Kuhn wrote: I think I can reproduce memory leaking problem while reopening an index. Lucene version tested is 1.4.1, version 1.4 final works OK. My JVM is: Could you try with the latest Lucene version from CVS? I cannot reproduce