On Dec 18, 2007, at 2:22 PM, Michael McCandless wrote:


Grant Ingersoll wrote:

The field that is causing the problem in the stack trace is neither binary nor compressed, nor is it even stored.

This would also be possible with the one bug I found on hitting an exception in DocumentsWriter.addDocument.

Basically the bug can cause only a subset of the stored fields to be added to the fdt file even though the vint header claimed more stored fields were written. Grant, you're really sure you saw no exception in Solr's logs right? Note that the exception would corrupt the index but would then not be detected until that corrupted segment gets merged, so it could have been in an earlier batch of added docs, for example.


I am not 100% on any of it, other than it does seem like there are still possibilities of it happening in my mind, even if I can't reproduce it.

FWIW, I was indexing Wikipedia using the EnwikiDocMaker to get docs and send them to Solr.

-Grant


---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to