Diagonistic info from checkIndex tool
7 of 85: name=_psc docCount=10184501
codec=Lucene46
compound=false
numFiles=14
size (MB)=5,174.959
diagnostics = {timestamp=1433473052105, os=Linux,
os.version=2.6.32-5-amd64, mergeFactor=10, source=merge,
lucene.version=4.6.1 1560866 - mark - 2014-01-23 20:11:13, os.arch=amd
64, mergeMaxNumSegments=-1, java.version=1.7.0_60, java.vendor=Oracle
Corporation}
has deletions [delGen=38]
test: open reader.........OK [2754377 deleted docs]
test: fields..............OK [1940 fields]
test: field norms.........OK [0 fields]
test: terms, freq, prox...OK [41624084 terms; 792821362 terms/docs
pairs; 648955541 tokens]
test (ignoring deletes): terms, freq, prox...OK [52210535 terms;
914842773 terms/docs pairs; 706281156 tokens]
test: stored fields.......OK [22290372 total field count; avg 3 fields
per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]
test: docvalues...........ERROR [213]
java.lang.ArrayIndexOutOfBoundsException: 213
at
org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer$2.get(Lucene45DocValuesProducer.java:325)
at org.apache.lucene.util.LongValues.get(LongValues.java:35)
at
org.apache.lucene.index.CheckIndex.checkNumericDocValues(CheckIndex.java:1479)
at
org.apache.lucene.index.CheckIndex.checkDocValues(CheckIndex.java:1523)
at
org.apache.lucene.index.CheckIndex.testDocValues(CheckIndex.java:1345)
at
org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:626)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:1941)
FAILED
WARNING: fixIndex() would remove reference to this segment; full
exception:
java.lang.RuntimeException: DocValues test failed
at
org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:639)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:1941)
On 9 June 2015 at 13:40, Umesh Prasad <[email protected]> wrote:
> Hi,
>
> During update, our lucene index has got corrupted and we are unable to
> root cause the same .. Any help/pointers would be appreciated ..
>
>
> java.io.IOException: Corrupted
>
> at
> org.apache.lucene.util.packed.BlockPackedReader.<init>(BlockPackedReader.java:57)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer.getNumeric(Lucene45DocValuesProducer.java:306)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer.getNumeric(Lucene45DocValuesProducer.java:285)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsReader.getNumeric(PerFieldDocValuesFormat.java:267)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.SegmentReader.getNumericDocValues(SegmentReader.java:408)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.ReadersAndUpdates$1.<init>(ReadersAndUpdates.java:408)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:407)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:287)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.IndexWriter.applyAllDeletesAndUpdates(IndexWriter.java:3126)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.IndexWriter.applyDeletesAndPurge(IndexWriter.java:4655)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.DocumentsWriter$ApplyDeletesEvent.process(DocumentsWriter.java:673)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4679)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4671)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
> at
> org.apache.lucene.index.IndexWriter.updateNumericDocValue(IndexWriter.java:1574)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>
>
>
> --
> Thanks & Regards
> Umesh Prasad
> Tech Lead @ flipkart.com
>
> in.linkedin.com/pub/umesh-prasad/6/5bb/580/
>
>
--
Thanks & Regards
Umesh Prasad
Tech Lead @ flipkart.com
in.linkedin.com/pub/umesh-prasad/6/5bb/580/
