[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-26 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778906#comment-13778906
 ] 

ASF subversion and git services commented on LUCENE-5218:
-

Commit 1526579 from [~mikemccand] in branch 'dev/trunk'
[ https://svn.apache.org/r1526579 ]

LUCENE-5218: add CHANGES

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>Assignee: Michael McCandless
> Fix For: 5.0, 4.5
>
> Attachments: lucene44-LUCENE-5218.zip, LUCENE-5218.patch
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-26 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778905#comment-13778905
 ] 

ASF subversion and git services commented on LUCENE-5218:
-

Commit 1526577 from [~mikemccand] in branch 'dev/branches/branch_4x'
[ https://svn.apache.org/r1526577 ]

LUCENE-5218: add CHANGES

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>Assignee: Michael McCandless
> Fix For: 5.0, 4.5
>
> Attachments: lucene44-LUCENE-5218.zip, LUCENE-5218.patch
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-26 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778903#comment-13778903
 ] 

ASF subversion and git services commented on LUCENE-5218:
-

Commit 1526575 from [~mikemccand] in branch 'dev/branches/lucene_solr_4_5'
[ https://svn.apache.org/r1526575 ]

LUCENE-5218: add CHANGES

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>Assignee: Michael McCandless
> Fix For: 5.0, 4.5
>
> Attachments: lucene44-LUCENE-5218.zip, LUCENE-5218.patch
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-26 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778859#comment-13778859
 ] 

ASF subversion and git services commented on LUCENE-5218:
-

Commit 1526546 from [~mikemccand] in branch 'dev/branches/lucene_solr_4_5'
[ https://svn.apache.org/r1526546 ]

LUCENE-5218: fix exception when trying to read a 0-byte BinaryDocValues field

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>Assignee: Michael McCandless
> Attachments: lucene44-LUCENE-5218.zip, LUCENE-5218.patch
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-26 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778849#comment-13778849
 ] 

ASF subversion and git services commented on LUCENE-5218:
-

Commit 1526538 from [~mikemccand] in branch 'dev/trunk'
[ https://svn.apache.org/r1526538 ]

LUCENE-5218: fix exception when trying to read a 0-byte BinaryDocValues field

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>Assignee: Michael McCandless
> Attachments: lucene44-LUCENE-5218.zip, LUCENE-5218.patch
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-26 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778847#comment-13778847
 ] 

ASF subversion and git services commented on LUCENE-5218:
-

Commit 1526529 from [~mikemccand] in branch 'dev/branches/branch_4x'
[ https://svn.apache.org/r1526529 ]

LUCENE-5218: fix exception when trying to read a 0-byte BinaryDocValues field

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>Assignee: Michael McCandless
> Attachments: lucene44-LUCENE-5218.zip, LUCENE-5218.patch
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-25 Thread Littlestar (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778368#comment-13778368
 ] 

Littlestar commented on LUCENE-5218:


patch tested OK.
please submit to trunk/trunk4x/trunk45, thanks.

Checking only these segments: _d8:
  44 of 54: name=_d8 docCount=19599
codec=hybaseStd42x
compound=true
numFiles=3
size (MB)=9.559
diagnostics = {timestamp=1379167874407, mergeFactor=22, 
os.version=2.6.32-358.el6.x86_64, os=Linux, lucene.version=4.4.0 1504776 - 
sarowe - 2013-07-19 02:49:47, source=merge, os.arch=amd64, 
mergeMaxNumSegments=1, java.version=1.7.0_25, java.vendor=Oracle Corporation}
no deletions
test: open reader.OK
test: fields..OK [29 fields]
test: field norms.OK [4 fields]
test: terms, freq, prox...OK [289268 terms; 3096641 terms/docs pairs; 
689694 tokens]
test: stored fields...OK [408046 total field count; avg 20.82 fields 
per doc]
test: term vectorsOK [0 total vector count; avg 0 term/freq vector 
fields per doc]
test: docvalues...OK [0 total doc count; 13 docvalues fields]

No problems were detected with this index.

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>Assignee: Michael McCandless
> Attachments: lucene44-LUCENE-5218.zip, LUCENE-5218.patch
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-25 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777956#comment-13777956
 ] 

Michael McCandless commented on LUCENE-5218:


Thanks Littlestar, I'm able to reproduce this with a small test case ... I'll 
add a patch shortly.

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>Assignee: Michael McCandless
> Attachments: lucene44-LUCENE-5218.zip
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-25 Thread Littlestar (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777672#comment-13777672
 ] 

Littlestar commented on LUCENE-5218:


mybe binary doc length=0.
myapp convert string to byte[], adding to binaryDocvalues.

above patch works for me.

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
> Attachments: lucene44-LUCENE-5218.zip
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-25 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777637#comment-13777637
 ] 

Michael McCandless commented on LUCENE-5218:


Hmm are you adding length=0 binary doc values?  It sounds like this could be a 
bug in that case, when the start aligns with the block boundary.

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
> Attachments: lucene44-LUCENE-5218.zip
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-25 Thread Littlestar (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777584#comment-13777584
 ] 

Littlestar commented on LUCENE-5218:


{noformat}
public void fillSlice(BytesRef b, long start, int length) {
  assert length >= 0: "length=" + length;
  assert length <= blockSize+1;
  final int index = (int) (start >> blockBits);
  final int offset = (int) (start & blockMask);
  b.length = length;
  if (blockSize - offset >= length) {
// Within block
b.bytes = blocks[index];
b.offset = offset;
  } else {
// Split
b.bytes = new byte[length];
b.offset = 0;
System.arraycopy(blocks[index], offset, b.bytes, 0, blockSize-offset);
System.arraycopy(blocks[1+index], 0, b.bytes, blockSize-offset, 
length-(blockSize-offset));
  }
}
{noformat}

I debug into above code.
when java.lang.ArrayIndexOutOfBoundsException occurs:
b=[], start=131072,lenth=0
index=2, offset=0, blocks.length=2

my patch:
 public void fillSlice(BytesRef b, long start, int length) {
  assert length >= 0: "length=" + length;
  assert length <= blockSize+1: "length=" + length;
  final int index = (int) (start >> blockBits);
  final int offset = (int) (start & blockMask);
  b.length = length;
  
  +if (index >= blocks.length) {
  +   // Outside block
  +   b.bytes = EMPTY_BYTES;
  +   b.offset = b.length = 0;
  +} else if (blockSize - offset >= length) {
// Within block
b.bytes = blocks[index];
b.offset = offset;
  } else {
// Split
b.bytes = new byte[length];
b.offset = 0;
System.arraycopy(blocks[index], offset, b.bytes, 0, blockSize-offset);
System.arraycopy(blocks[1+index], 0, b.bytes, blockSize-offset, 
length-(blockSize-offset));
  }
}
  


> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
> Attachments: lucene44-LUCENE-5218.zip
>
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-24 Thread Littlestar (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776068#comment-13776068
 ] 

Littlestar commented on LUCENE-5218:


org.apache.lucene.index.CheckIndex -segment _d8 /tmp/backup/indexdir
failed agian.

how to narrow it down, thanks.

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-24 Thread Littlestar (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776059#comment-13776059
 ] 

Littlestar commented on LUCENE-5218:


I can't narrow it down, but I backup the index (5G)

I run core\src\java\org\apache\lucene\index\CheckIndex.java

java.lang.ArrayIndexOutOfBoundsException: 2
at 
org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
at 
org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
at 
org.apache.lucene.index.CheckIndex.checkBinaryDocValues(CheckIndex.java:1316)
at 
org.apache.lucene.index.CheckIndex.checkDocValues(CheckIndex.java:1420)
at 
org.apache.lucene.index.CheckIndex.testDocValues(CheckIndex.java:1291)
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:615)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:1854)



> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-17 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769460#comment-13769460
 ] 

Michael McCandless commented on LUCENE-5218:


Can you reproduce this, starting from a clean index?  If so, try to narrow it 
down, e.g. try not passing any of those extra JVM args and see if it still 
repros?

It's also quite possible it's a real bug somewhere in how binary DV fields are 
written/read!  So if you can boil it down to a smallish test case then we can 
better narrow it down.

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-17 Thread Littlestar (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769327#comment-13769327
 ] 

Littlestar commented on LUCENE-5218:


jvm args:
-Xss256k -XX:+UnlockExperimentalVMOptions -XX:+UseG1GC -XX:MaxGCPauseMillis=200 
-XX:GCPauseIntervalMillis=1000 -XX:NewRatio=2 -XX:SurvivorRatio=1 
maybe UseG1GC has bug?

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-16 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768380#comment-13768380
 ] 

Michael McCandless commented on LUCENE-5218:


Don't use 7u40: there is apparently a JVM bug that can cause index corruption 
like this (LUCENE-5212).

But 7u25 should be safe.  If you use only 7u25, and start from a new index, you 
can reproduce this exception?  Can you run CheckIndex on the resulting index 
and post the output?

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-16 Thread Littlestar (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768344#comment-13768344
 ] 

Littlestar commented on LUCENE-5218:


my app continue insert records, may be 10-1 records per seconds.
lucene index with very small segments, so I call forceMerge(80) before each 
call.

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-16 Thread Littlestar (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768322#comment-13768322
 ] 

Littlestar commented on LUCENE-5218:


java version "1.7.0_25"
I also build openjdk 7u40 with openjdk-7u40-fcs-src-b43-26_aug_2013.zip
two jdks has same problem.


> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-16 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768253#comment-13768253
 ] 

Michael McCandless commented on LUCENE-5218:


Which JVM are you using?

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-5218) background merge hit exception && Caused by: java.lang.ArrayIndexOutOfBoundsException

2013-09-15 Thread Littlestar (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768098#comment-13768098
 ] 

Littlestar commented on LUCENE-5218:


PagedBytes.java#fillSlice
maybe wrong start??


public void fillSlice(BytesRef b, long start, int length) {
  assert length >= 0: "length=" + length;
  assert length <= blockSize+1;
  final int index = (int) (start >> blockBits);
  final int offset = (int) (start & blockMask);
  b.length = length;
  if (blockSize - offset >= length) {
// Within block
b.bytes = blocks[index];
b.offset = offset;
  } else {
// Split
b.bytes = new byte[length];
b.offset = 0;
System.arraycopy(blocks[index], offset, b.bytes, 0, blockSize-offset);
System.arraycopy(blocks[1+index], 0, b.bytes, blockSize-offset, 
length-(blockSize-offset));
  }
}

> background merge hit exception && Caused by: 
> java.lang.ArrayIndexOutOfBoundsException
> -
>
> Key: LUCENE-5218
> URL: https://issues.apache.org/jira/browse/LUCENE-5218
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/index
>Affects Versions: 4.4
> Environment: Linux MMapDirectory.
>Reporter: Littlestar
>
> forceMerge(80)
> ==
> Caused by: java.io.IOException: background merge hit exception: 
> _3h(4.4):c79921/2994 _3vs(4.4):c38658 _eq(4.4):c38586 _h1(4.4):c37370 
> _16k(4.4):c36591 _j4(4.4):c34316 _dx(4.4):c30550 _3m6(4.4):c30058 
> _dl(4.4):c28440 _d8(4.4):c19599 _dy(4.4):c1500/75 _h2(4.4):c1500 into _3vt 
> [maxNumSegments=80]
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1714)
>   at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
>   at 
> com.xxx.yyy.engine.lucene.LuceneEngine.flushAndReopen(LuceneEngine.java:1295)
>   ... 4 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.lucene.util.PagedBytes$Reader.fillSlice(PagedBytes.java:92)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesProducer$6.get(Lucene42DocValuesProducer.java:267)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.setNext(DocValuesConsumer.java:239)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer$2$1.hasNext(DocValuesConsumer.java:201)
>   at 
> org.apache.lucene.codecs.lucene42.Lucene42DocValuesConsumer.addBinaryField(Lucene42DocValuesConsumer.java:218)
>   at 
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:110)
>   at 
> org.apache.lucene.codecs.DocValuesConsumer.mergeBinaryField(DocValuesConsumer.java:186)
>   at 
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:171)
>   at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:108)
>   at 
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)
>   at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
>   at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org