[jira] [Commented] (CASSANDRA-12238) Unexpected exception during request java.lang.IndexOutOfBoundsException: null
[ https://issues.apache.org/jira/browse/CASSANDRA-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539866#comment-16539866 ] Chris Richards commented on CASSANDRA-12238: Found CASSANDRA-14167 which looks similar - will look to try the patch from that ticket. > Unexpected exception during request java.lang.IndexOutOfBoundsException: null > - > > Key: CASSANDRA-12238 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12238 > Project: Cassandra > Issue Type: Bug > Components: Core > Environment: datastax-ddc-3.7.0, CentOS 7, x86, JDK 1.8.0u91 >Reporter: Gábor Auth >Priority: Major > Labels: counters > Fix For: 3.0.x, 3.11.x, 4.x > > > Our two DCs and eight nodes cluster throws sometimes: > {code} > ERROR [SharedPool-Worker-25] 2016-07-19 16:22:14,643 ErrorMessage.java:338 - > Unexpected exception during request > java.lang.IndexOutOfBoundsException: null > at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_91] > at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) > ~[na:1.8.0_91] > at > org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:141) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.access$100(CounterContext.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.(CounterContext.java:758) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.wrap(CounterContext.java:765) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.merge(CounterContext.java:271) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.Conflicts.mergeCounterValues(Conflicts.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Cells.reconcile(Cells.java:143) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:614) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:572) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Row$Merger.merge(Row.java:549) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:473) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:437) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:419) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:279) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:112) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.FilteredRows.isEmpty(FilteredRows.java:30) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.closeIfEmpty(Filter.java:49) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:22) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:6) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at >
[jira] [Commented] (CASSANDRA-12238) Unexpected exception during request java.lang.IndexOutOfBoundsException: null
[ https://issues.apache.org/jira/browse/CASSANDRA-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537259#comment-16537259 ] Chris Richards commented on CASSANDRA-12238: I am also seeing this with 3.11.2 in a test environment where we have 2 nodes in one datacenter, and 1 node in another datacenter. So far we have only seen this exception in the 2 node datacenter. It seems to be relatively easy to recreate on this particular instance (but we are yet to see it on other instances). WARN [ReadStage-2] 2018-07-09 16:23:28,410 AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread Thread[ReadStage-2,5,main]: {} java.lang.IndexOutOfBoundsException: null at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_131] at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) ~[na:1.8.0_131] at org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:173) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.context.CounterContext.updateDigest(CounterContext.java:696) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.rows.AbstractCell.digest(AbstractCell.java:126) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.rows.AbstractRow.digest(AbstractRow.java:81) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.rows.AbstractRow.digest(AbstractRow.java:68) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.rows.UnfilteredRowIterators.digest(UnfilteredRowIterators.java:181) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.partitions.UnfilteredPartitionIterators.digest(UnfilteredPartitionIterators.java:263) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.ReadResponse.makeDigest(ReadResponse.java:120) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.ReadResponse.createDigestResponse(ReadResponse.java:87) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.ReadCommand.createResponse(ReadCommand.java:345) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.ReadCommandVerbHandler.doVerb(ReadCommandVerbHandler.java:50) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:66) ~[apache-cassandra-3.11.2.jar:3.11.2] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_131] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:134) [apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) [apache-cassandra-3.11.2.jar:3.11.2] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_131] etc > Unexpected exception during request java.lang.IndexOutOfBoundsException: null > - > > Key: CASSANDRA-12238 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12238 > Project: Cassandra > Issue Type: Bug > Components: Core > Environment: datastax-ddc-3.7.0, CentOS 7, x86, JDK 1.8.0u91 >Reporter: Gábor Auth >Priority: Major > Labels: counters > Fix For: 3.0.x, 3.11.x, 4.x > > > Our two DCs and eight nodes cluster throws sometimes: > {code} > ERROR [SharedPool-Worker-25] 2016-07-19 16:22:14,643 ErrorMessage.java:338 - > Unexpected exception during request > java.lang.IndexOutOfBoundsException: null > at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_91] > at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) > ~[na:1.8.0_91] > at > org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:141) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.access$100(CounterContext.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.(CounterContext.java:758) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.wrap(CounterContext.java:765) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.merge(CounterContext.java:271) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.Conflicts.mergeCounterValues(Conflicts.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at
[jira] [Commented] (CASSANDRA-12238) Unexpected exception during request java.lang.IndexOutOfBoundsException: null
[ https://issues.apache.org/jira/browse/CASSANDRA-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436197#comment-16436197 ] Jeff Jirsa commented on CASSANDRA-12238: Re-opened (Also cc [~iamaleksey] because counters) > Unexpected exception during request java.lang.IndexOutOfBoundsException: null > - > > Key: CASSANDRA-12238 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12238 > Project: Cassandra > Issue Type: Bug > Components: Core > Environment: datastax-ddc-3.7.0, CentOS 7, x86, JDK 1.8.0u91 >Reporter: Gábor Auth >Priority: Major > Labels: counters > Fix For: 3.0.x, 3.11.x, 4.x > > > Our two DCs and eight nodes cluster throws sometimes: > {code} > ERROR [SharedPool-Worker-25] 2016-07-19 16:22:14,643 ErrorMessage.java:338 - > Unexpected exception during request > java.lang.IndexOutOfBoundsException: null > at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_91] > at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) > ~[na:1.8.0_91] > at > org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:141) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.access$100(CounterContext.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.(CounterContext.java:758) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.wrap(CounterContext.java:765) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.merge(CounterContext.java:271) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.Conflicts.mergeCounterValues(Conflicts.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Cells.reconcile(Cells.java:143) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:614) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:572) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Row$Merger.merge(Row.java:549) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:473) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:437) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:419) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:279) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:112) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.FilteredRows.isEmpty(FilteredRows.java:30) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.closeIfEmpty(Filter.java:49) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:22) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:6) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at >
[jira] [Commented] (CASSANDRA-12238) Unexpected exception during request java.lang.IndexOutOfBoundsException: null
[ https://issues.apache.org/jira/browse/CASSANDRA-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435918#comment-16435918 ] Steve Severance commented on CASSANDRA-12238: - I have I think a good understanding of what causes this. I have a counter table with the following schema: CREATE TABLE WorkQueueIndex_v2( partitionid int, shardid uuid, count counter, complete counter, size counter, PRIMARY KEY ((partitionid),shardid) ); If I run the following query at consistency level ONE it works fine: SELECT shardid, complete, count FROM workqueueindex_v2 where partitionid = 14; However if you run the same query with consistency level QUORUM it fails. The workaround is to select all the counter columns in the table instead of a subset of them. [~ifesdjeen]: Can we reopen this issue? > Unexpected exception during request java.lang.IndexOutOfBoundsException: null > - > > Key: CASSANDRA-12238 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12238 > Project: Cassandra > Issue Type: Bug > Environment: datastax-ddc-3.7.0, CentOS 7, x86, JDK 1.8.0u91 >Reporter: Gábor Auth >Priority: Major > > Our two DCs and eight nodes cluster throws sometimes: > {code} > ERROR [SharedPool-Worker-25] 2016-07-19 16:22:14,643 ErrorMessage.java:338 - > Unexpected exception during request > java.lang.IndexOutOfBoundsException: null > at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_91] > at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) > ~[na:1.8.0_91] > at > org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:141) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.access$100(CounterContext.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.(CounterContext.java:758) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.wrap(CounterContext.java:765) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.merge(CounterContext.java:271) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.Conflicts.mergeCounterValues(Conflicts.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Cells.reconcile(Cells.java:143) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:614) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:572) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Row$Merger.merge(Row.java:549) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:473) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:437) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:419) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:279) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:112) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.FilteredRows.isEmpty(FilteredRows.java:30) >
[jira] [Commented] (CASSANDRA-12238) Unexpected exception during request java.lang.IndexOutOfBoundsException: null
[ https://issues.apache.org/jira/browse/CASSANDRA-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421423#comment-16421423 ] Steve Severance commented on CASSANDRA-12238: - I am seeing something that is potentially similar following an upgrade from 3.0.9 to 3.11.2. I don't know if it actually has any impact on the application yet. WARN [ReadStage-6] 2018-03-31 18:18:42,439 AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread Thread[ReadStage-6,5,main]: {} java.lang.IndexOutOfBoundsException: null at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_161] at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) ~[na:1.8.0_161] at org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:173) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.context.CounterContext.updateDigest(CounterContext.java:696) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.rows.AbstractCell.digest(AbstractCell.java:126) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.rows.AbstractRow.digest(AbstractRow.java:81) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.rows.AbstractRow.digest(AbstractRow.java:68) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.rows.UnfilteredRowIterators.digest(UnfilteredRowIterators.java:181) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.partitions.UnfilteredPartitionIterators.digest(UnfilteredPartitionIterators.java:263) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.ReadResponse.makeDigest(ReadResponse.java:120) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.ReadResponse.createDigestResponse(ReadResponse.java:87) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.ReadCommand.createResponse(ReadCommand.java:345) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.db.ReadCommandVerbHandler.doVerb(ReadCommandVerbHandler.java:50) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:66) ~[apache-cassandra-3.11.2.jar:3.11.2] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_161] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162) ~[apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:134) [apache-cassandra-3.11.2.jar:3.11.2] at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) [apache-cassandra-3.11.2.jar:3.11.2] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_161] > Unexpected exception during request java.lang.IndexOutOfBoundsException: null > - > > Key: CASSANDRA-12238 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12238 > Project: Cassandra > Issue Type: Bug > Environment: datastax-ddc-3.7.0, CentOS 7, x86, JDK 1.8.0u91 >Reporter: Gábor Auth >Priority: Major > > Our two DCs and eight nodes cluster throws sometimes: > {code} > ERROR [SharedPool-Worker-25] 2016-07-19 16:22:14,643 ErrorMessage.java:338 - > Unexpected exception during request > java.lang.IndexOutOfBoundsException: null > at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_91] > at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) > ~[na:1.8.0_91] > at > org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:141) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.access$100(CounterContext.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.(CounterContext.java:758) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.wrap(CounterContext.java:765) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.merge(CounterContext.java:271) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.Conflicts.mergeCounterValues(Conflicts.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Cells.reconcile(Cells.java:143) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:614) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:572) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at >
[jira] [Commented] (CASSANDRA-12238) Unexpected exception during request java.lang.IndexOutOfBoundsException: null
[ https://issues.apache.org/jira/browse/CASSANDRA-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934750#comment-15934750 ] Alex Petrov commented on CASSANDRA-12238: - Right, sorry, I didn't notice the timestamp. I'll close with can't reproduce for now. > Unexpected exception during request java.lang.IndexOutOfBoundsException: null > - > > Key: CASSANDRA-12238 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12238 > Project: Cassandra > Issue Type: Bug > Environment: datastax-ddc-3.7.0, CentOS 7, x86, JDK 1.8.0u91 >Reporter: Gábor Auth > > Our two DCs and eight nodes cluster throws sometimes: > {code} > ERROR [SharedPool-Worker-25] 2016-07-19 16:22:14,643 ErrorMessage.java:338 - > Unexpected exception during request > java.lang.IndexOutOfBoundsException: null > at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_91] > at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) > ~[na:1.8.0_91] > at > org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:141) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.access$100(CounterContext.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.(CounterContext.java:758) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.wrap(CounterContext.java:765) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.merge(CounterContext.java:271) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.Conflicts.mergeCounterValues(Conflicts.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Cells.reconcile(Cells.java:143) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:614) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:572) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Row$Merger.merge(Row.java:549) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:473) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:437) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:419) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:279) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:112) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.FilteredRows.isEmpty(FilteredRows.java:30) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.closeIfEmpty(Filter.java:49) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:22) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:6) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at >
[jira] [Commented] (CASSANDRA-12238) Unexpected exception during request java.lang.IndexOutOfBoundsException: null
[ https://issues.apache.org/jira/browse/CASSANDRA-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934746#comment-15934746 ] Gábor Auth commented on CASSANDRA-12238: Hm... unfortunately, I don't know, it was almost a year ago... :/ > Unexpected exception during request java.lang.IndexOutOfBoundsException: null > - > > Key: CASSANDRA-12238 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12238 > Project: Cassandra > Issue Type: Bug > Environment: datastax-ddc-3.7.0, CentOS 7, x86, JDK 1.8.0u91 >Reporter: Gábor Auth > > Our two DCs and eight nodes cluster throws sometimes: > {code} > ERROR [SharedPool-Worker-25] 2016-07-19 16:22:14,643 ErrorMessage.java:338 - > Unexpected exception during request > java.lang.IndexOutOfBoundsException: null > at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_91] > at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) > ~[na:1.8.0_91] > at > org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:141) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.access$100(CounterContext.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.(CounterContext.java:758) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.wrap(CounterContext.java:765) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.merge(CounterContext.java:271) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.Conflicts.mergeCounterValues(Conflicts.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Cells.reconcile(Cells.java:143) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:614) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:572) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Row$Merger.merge(Row.java:549) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:473) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:437) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:419) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:279) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:112) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.FilteredRows.isEmpty(FilteredRows.java:30) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.closeIfEmpty(Filter.java:49) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:22) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:6) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at >
[jira] [Commented] (CASSANDRA-12238) Unexpected exception during request java.lang.IndexOutOfBoundsException: null
[ https://issues.apache.org/jira/browse/CASSANDRA-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934720#comment-15934720 ] Alex Petrov commented on CASSANDRA-12238: - It would be great to know under which conditions this is triggered: what the schema is, what query exactly this was. > Unexpected exception during request java.lang.IndexOutOfBoundsException: null > - > > Key: CASSANDRA-12238 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12238 > Project: Cassandra > Issue Type: Bug > Environment: datastax-ddc-3.7.0, CentOS 7, x86, JDK 1.8.0u91 >Reporter: Gábor Auth > > Our two DCs and eight nodes cluster throws sometimes: > {code} > ERROR [SharedPool-Worker-25] 2016-07-19 16:22:14,643 ErrorMessage.java:338 - > Unexpected exception during request > java.lang.IndexOutOfBoundsException: null > at java.nio.Buffer.checkIndex(Buffer.java:546) ~[na:1.8.0_91] > at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:314) > ~[na:1.8.0_91] > at > org.apache.cassandra.db.context.CounterContext.headerLength(CounterContext.java:141) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.access$100(CounterContext.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.(CounterContext.java:758) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext$ContextState.wrap(CounterContext.java:765) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.context.CounterContext.merge(CounterContext.java:271) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.Conflicts.mergeCounterValues(Conflicts.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Cells.reconcile(Cells.java:143) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:614) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.Row$Merger$ColumnDataReducer.getReduced(Row.java:572) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.rows.Row$Merger.merge(Row.java:549) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:473) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:437) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:419) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:279) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:112) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.FilteredRows.isEmpty(FilteredRows.java:30) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.closeIfEmpty(Filter.java:49) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:22) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:6) > ~[apache-cassandra-3.7.0.jar:3.7.0] > at > org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:76) > ~[apache-cassandra-3.7.0.jar:3.7.0]