Found the issue .. It was caused by Solr during replication ..
On 9 June 2015 at 13:41, Umesh Prasad <umesh.i...@gmail.com> wrote:
> Diagonistic info from checkIndex tool
>
> 7 of 85: name=_psc docCount=10184501
>
> codec=Lucene46
>
> compound=false
>
> numFiles=14
>
> size (MB)=5,174.959
>
> diagnostics = {timestamp=1433473052105, os=Linux,
> os.version=2.6.32-5-amd64, mergeFactor=10, source=merge,
> lucene.version=4.6.1 1560866 - mark - 2014-01-23 20:11:13, os.arch=amd
>
> 64, mergeMaxNumSegments=-1, java.version=1.7.0_60, java.vendor=Oracle
> Corporation}
>
> has deletions [delGen=38]
>
> test: open reader.........OK [2754377 deleted docs]
>
> test: fields..............OK [1940 fields]
>
> test: field norms.........OK [0 fields]
>
> test: terms, freq, prox...OK [41624084 terms; 792821362 terms/docs
> pairs; 648955541 tokens]
>
> test (ignoring deletes): terms, freq, prox...OK [52210535 terms;
> 914842773 terms/docs pairs; 706281156 tokens]
>
> test: stored fields.......OK [22290372 total field count; avg 3 fields
> per doc]
>
> test: term vectors........OK [0 total vector count; avg 0 term/freq
> vector fields per doc]
>
> test: docvalues...........ERROR [213]
>
> java.lang.ArrayIndexOutOfBoundsException: 213
>
> at
> org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer$2.get(Lucene45DocValuesProducer.java:325)
>
> at org.apache.lucene.util.LongValues.get(LongValues.java:35)
>
> at
> org.apache.lucene.index.CheckIndex.checkNumericDocValues(CheckIndex.java:1479)
>
> at
> org.apache.lucene.index.CheckIndex.checkDocValues(CheckIndex.java:1523)
>
> at
> org.apache.lucene.index.CheckIndex.testDocValues(CheckIndex.java:1345)
>
> at
> org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:626)
>
> at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:1941)
>
> FAILED
>
> WARNING: fixIndex() would remove reference to this segment; full
> exception:
>
> java.lang.RuntimeException: DocValues test failed
>
> at
> org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:639)
>
> at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:1941)
>
> On 9 June 2015 at 13:40, Umesh Prasad <umesh.i...@gmail.com> wrote:
>
>> Hi,
>>
>> During update, our lucene index has got corrupted and we are unable
>> to root cause the same .. Any help/pointers would be appreciated ..
>>
>>
>> java.io.IOException: Corrupted
>>
>> at
>> org.apache.lucene.util.packed.BlockPackedReader.<init>(BlockPackedReader.java:57)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer.getNumeric(Lucene45DocValuesProducer.java:306)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer.getNumeric(Lucene45DocValuesProducer.java:285)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsReader.getNumeric(PerFieldDocValuesFormat.java:267)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.SegmentReader.getNumericDocValues(SegmentReader.java:408)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.ReadersAndUpdates$1.<init>(ReadersAndUpdates.java:408)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:407)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:287)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.IndexWriter.applyAllDeletesAndUpdates(IndexWriter.java:3126)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.IndexWriter.applyDeletesAndPurge(IndexWriter.java:4655)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.DocumentsWriter$ApplyDeletesEvent.process(DocumentsWriter.java:673)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4679)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4671)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>> at
>> org.apache.lucene.index.IndexWriter.updateNumericDocValue(IndexWriter.java:1574)
>> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>>
>>
>>
>>
>> --
>> Thanks & Regards
>> Umesh Prasad
>> Tech Lead @ flipkart.com
>>
>> in.linkedin.com/pub/umesh-prasad/6/5bb/580/
>>
>>
>
>
> --
> Thanks & Regards
> Umesh Prasad
> Tech Lead @ flipkart.com
>
> in.linkedin.com/pub/umesh-prasad/6/5bb/580/
>
>
--
Thanks & Regards
Umesh Prasad
Tech Lead @ flipkart.com
in.linkedin.com/pub/umesh-prasad/6/5bb/580/
