Re: java.lang.RuntimeException: after flush: fdx size mismatch

2009-05-30 Thread Michael McCandless
that affects the behaviour! Thanks, James -- Forwarded message -- From: James X hello.nigerian.spamm...@gmail.com Date: Thu, May 21, 2009 at 2:24 PM Subject: Re: java.lang.RuntimeException: after flush: fdx size mismatch To: solr-user@lucene.apache.org Hi Mike

Re: java.lang.RuntimeException: after flush: fdx size mismatch

2009-05-29 Thread Michael McCandless
at 2:24 PM Subject: Re: java.lang.RuntimeException: after flush: fdx size mismatch To: solr-user@lucene.apache.org Hi Mike,Documents are web pages, about 20 fields, mostly strings, a couple of integers, booleans and one html field (for document body content). I do have a multi-threaded

Re: java.lang.RuntimeException: after flush: fdx size mismatch

2009-05-29 Thread James X
: after flush: fdx size mismatch To: solr-user@lucene.apache.org Hi Mike,Documents are web pages, about 20 fields, mostly strings, a couple of integers, booleans and one html field (for document body content). I do have a multi-threaded client pushing docs to Solr, so yes, I suppose

Re: java.lang.RuntimeException: after flush: fdx size mismatch

2009-05-21 Thread Michael McCandless
On Wed, May 20, 2009 at 11:18 AM, James X hello.nigerian.spamm...@gmail.com wrote: Hi Mike, thanks for the quick response: $ java -version java version 1.6.0_11 Java(TM) SE Runtime Environment (build 1.6.0_11-b03) Java HotSpot(TM) 64-Bit Server VM (build 11.0-b16, mixed mode) I hadn't

Re: java.lang.RuntimeException: after flush: fdx size mismatch

2009-05-21 Thread Michael McCandless
Another question: are there any other exceptions in your logs? Eg problems adding certain documents, or anything? Mike On Wed, May 20, 2009 at 11:18 AM, James X hello.nigerian.spamm...@gmail.com wrote: Hi Mike, thanks for the quick response: $ java -version java version 1.6.0_11 Java(TM)

Re: java.lang.RuntimeException: after flush: fdx size mismatch

2009-05-21 Thread Michael McCandless
If you're able to run a patched version of Lucene, can you apply the attached patch, run it, get the issue to happen again, and post back the resulting exception? It only adds further diagnostics to that RuntimeException you're hitting. Another thing to try is turning on assertions, which may

Re: java.lang.RuntimeException: after flush: fdx size mismatch

2009-05-21 Thread James X
Hi Mike,Documents are web pages, about 20 fields, mostly strings, a couple of integers, booleans and one html field (for document body content). I do have a multi-threaded client pushing docs to Solr, so yes, I suppose that would mean I have several active Solr worker threads. The only

Re: java.lang.RuntimeException: after flush: fdx size mismatch

2009-05-20 Thread Michael McCandless
Hmm... somehow Lucene is flushing a new segment on closing the IndexWriter, and thinks 1 doc had been added to the stored fields file, yet the fdx file is the wrong size (0 bytes). This check ( exception) are designed to prevent corruption from entering the index, so it's at least good to see

Re: java.lang.RuntimeException: after flush: fdx size mismatch

2009-05-20 Thread James X
Hi Mike, thanks for the quick response: $ java -version java version 1.6.0_11 Java(TM) SE Runtime Environment (build 1.6.0_11-b03) Java HotSpot(TM) 64-Bit Server VM (build 11.0-b16, mixed mode) I hadn't noticed the 268m trigger for LUCENE-1521 - I'm definitely not hitting that yet! The