Hi Dan,

java.io.IOException: read past EOF
       at org.apache.lucene.store.InputStream.refill(InputStream.java:154)
       at org.apache.lucene.store.InputStream.readByte(InputStream.java:43)
       at org.apache.lucene.store.InputStream.readBytes(InputStream.java
:57)
       at org.apache.lucene.index.SegmentReader.norms(SegmentReader.java
:356)
       at org.apache.lucene.index.MultiReader.norms(MultiReader.java:159)
       at org.apache.lucene.search.TermQuery$TermWeight.scorer(
TermQuery.java:64)
       at org.apache.lucene.search.BooleanQuery$BooleanWeight.scorer(
BooleanQuery.java:165)
       at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java
:117)
       at org.apache.lucene.search.MultiSearcher.search(MultiSearcher.java
:141)
       at org.apache.lucene.search.Hits.getMoreDocs(Hits.java:64)
       at org.apache.lucene.search.Hits.<init>(Hits.java:51)

[snip]

We've seen similar errors on occasion, though our stack trace is a bit different:

java.io.IOException: read past EOF
at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:60) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:33)
        at org.apache.lucene.store.IndexInput.readInt(IndexInput.java:46)
        at org.apache.lucene.store.IndexInput.readLong(IndexInput.java:69)
        at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:62)
at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:284)
        at org.apache.lucene.index.MultiReader.document(MultiReader.java:104)
        at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:83)
at org.apache.nutch.searcher.IndexSearcher.getDetails(IndexSearcher.java:113)
        at org.apache.nutch.searcher.NutchBean.getDetails(NutchBean.java:300)
        at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.nutch.ipc.RPC$1.call(RPC.java:389)
        at org.apache.nutch.ipc.Server$Handler.run(Server.java:193)

Our config is for a Nutch distributed searcher. These errors seem to occur under heavy load for us.

[snip]

Anyone can tell me what is the problem?
I opened in readonly mode my index with luke and I don't have any problem to
check contents.

Could be my index corrupted?
What is the usually code at startup to do a check of integrity of lucene
index? With this code I can detect if my index is corrupted and force to
create a new index.

We haven't yet tracked it down, but at least in our case I don't think it's a bad index. After seeing a few postings about this same general problem, I'm guessing there's a bug hiding someplace.

Sorry to not have a better answer...

-- Ken
--
Ken Krugler
Krugle, Inc.
+1 530-210-6378
"Find Code, Find Answers"

---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to