[jira] [Commented] (CASSANDRA-8905) IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12

2015-04-03 Thread Philip Thompson (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394511#comment-14394511
 ] 

Philip Thompson commented on CASSANDRA-8905:


[~krummas], if scrubbing solved the issue, do we consider this a problem?

 IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12
 ---

 Key: CASSANDRA-8905
 URL: https://issues.apache.org/jira/browse/CASSANDRA-8905
 Project: Cassandra
  Issue Type: Bug
Reporter: Erik Forsberg
 Fix For: 2.0.15


 After upgrade from 1.2.18 to 2.0.12, I've started to get exceptions like:
 {noformat}
 ERROR [CompactionExecutor:1149] 2015-03-04 11:48:46,045 CassandraDaemon.java 
 (line 199) Exception in thread Thread[CompactionExecutor:1149,1,main]
 java.lang.IllegalArgumentException: Illegal Capacity: -2147483648
 at java.util.ArrayList.init(ArrayList.java:142)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:182)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:194)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:138)
 at 
 org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:186)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:98)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.init(PrecompactedRow.java:85)
 at 
 org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:196)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:74)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:55)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:115)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:98)
 at 
 com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
 at 
 com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:161)
 at 
 org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:60)
 at 
 org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
 at 
 org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:198)
 at 
 java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
 {noformat}
 I've identified which sstable is causing this, it's an -ic- format sstable, 
 i.e. something written before the upgrade. I can repeat with 
 forceUserDefinedCompaction.
 Running upgradesstables also causes the same exception. 
 Scrub helps, but skips a row as incorrect. 
 I can share the sstable privately if it helps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-8905) IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12

2015-04-03 Thread Marcus Eriksson (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394649#comment-14394649
 ] 

Marcus Eriksson commented on CASSANDRA-8905:


[~philipthompson] no, then I assume it is a corrupt sstable

 IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12
 ---

 Key: CASSANDRA-8905
 URL: https://issues.apache.org/jira/browse/CASSANDRA-8905
 Project: Cassandra
  Issue Type: Bug
Reporter: Erik Forsberg
 Fix For: 2.0.15


 After upgrade from 1.2.18 to 2.0.12, I've started to get exceptions like:
 {noformat}
 ERROR [CompactionExecutor:1149] 2015-03-04 11:48:46,045 CassandraDaemon.java 
 (line 199) Exception in thread Thread[CompactionExecutor:1149,1,main]
 java.lang.IllegalArgumentException: Illegal Capacity: -2147483648
 at java.util.ArrayList.init(ArrayList.java:142)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:182)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:194)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:138)
 at 
 org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:186)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:98)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.init(PrecompactedRow.java:85)
 at 
 org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:196)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:74)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:55)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:115)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:98)
 at 
 com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
 at 
 com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:161)
 at 
 org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:60)
 at 
 org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
 at 
 org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:198)
 at 
 java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
 {noformat}
 I've identified which sstable is causing this, it's an -ic- format sstable, 
 i.e. something written before the upgrade. I can repeat with 
 forceUserDefinedCompaction.
 Running upgradesstables also causes the same exception. 
 Scrub helps, but skips a row as incorrect. 
 I can share the sstable privately if it helps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-8905) IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12

2015-03-16 Thread Marcin Pietraszek (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362848#comment-14362848
 ] 

Marcin Pietraszek commented on CASSANDRA-8905:
--

SStables causing those problems were created shortly before turning off 
cassandra in version 1.2.18 when memtables were flushed. After scrubing problem 
disapeared. 

 IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12
 ---

 Key: CASSANDRA-8905
 URL: https://issues.apache.org/jira/browse/CASSANDRA-8905
 Project: Cassandra
  Issue Type: Bug
Reporter: Erik Forsberg

 After upgrade from 1.2.18 to 2.0.12, I've started to get exceptions like:
 {noformat}
 ERROR [CompactionExecutor:1149] 2015-03-04 11:48:46,045 CassandraDaemon.java 
 (line 199) Exception in thread Thread[CompactionExecutor:1149,1,main]
 java.lang.IllegalArgumentException: Illegal Capacity: -2147483648
 at java.util.ArrayList.init(ArrayList.java:142)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:182)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:194)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:138)
 at 
 org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:186)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:98)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.init(PrecompactedRow.java:85)
 at 
 org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:196)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:74)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:55)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:115)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:98)
 at 
 com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
 at 
 com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:161)
 at 
 org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:60)
 at 
 org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
 at 
 org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:198)
 at 
 java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
 {noformat}
 I've identified which sstable is causing this, it's an -ic- format sstable, 
 i.e. something written before the upgrade. I can repeat with 
 forceUserDefinedCompaction.
 Running upgradesstables also causes the same exception. 
 Scrub helps, but skips a row as incorrect. 
 I can share the sstable privately if it helps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-8905) IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12

2015-03-04 Thread Marcus Eriksson (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346909#comment-14346909
 ] 

Marcus Eriksson commented on CASSANDRA-8905:


is it all -ic- sstables or just a single one?

are you using super columns?

 IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12
 ---

 Key: CASSANDRA-8905
 URL: https://issues.apache.org/jira/browse/CASSANDRA-8905
 Project: Cassandra
  Issue Type: Bug
Reporter: Erik Forsberg

 After upgrade from 1.2.18 to 2.0.12, I've started to get exceptions like:
 {noformat}
 ERROR [CompactionExecutor:1149] 2015-03-04 11:48:46,045 CassandraDaemon.java 
 (line 199) Exception in thread Thread[CompactionExecutor:1149,1,main]
 java.lang.IllegalArgumentException: Illegal Capacity: -2147483648
 at java.util.ArrayList.init(ArrayList.java:142)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:182)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:194)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:138)
 at 
 org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:186)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:98)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.init(PrecompactedRow.java:85)
 at 
 org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:196)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:74)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:55)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:115)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:98)
 at 
 com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
 at 
 com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:161)
 at 
 org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:60)
 at 
 org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
 at 
 org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:198)
 at 
 java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
 {noformat}
 I've identified which sstable is causing this, it's an -ic- format sstable, 
 i.e. something written before the upgrade. I can repeat with 
 forceUserDefinedCompaction.
 Running upgradesstables also causes the same exception. 
 Scrub helps, but skips a row as incorrect. 
 I can share the sstable privately if it helps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-8905) IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12

2015-03-04 Thread Erik Forsberg (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346939#comment-14346939
 ] 

Erik Forsberg commented on CASSANDRA-8905:
--

Does not happen for all -ic- sstables, but I see a significant amount of these 
sstables spread over my cluster.

Yes, using supercolumns.

 IllegalArgumentException in compaction of -ic- file after upgrade to 2.0.12
 ---

 Key: CASSANDRA-8905
 URL: https://issues.apache.org/jira/browse/CASSANDRA-8905
 Project: Cassandra
  Issue Type: Bug
Reporter: Erik Forsberg

 After upgrade from 1.2.18 to 2.0.12, I've started to get exceptions like:
 {noformat}
 ERROR [CompactionExecutor:1149] 2015-03-04 11:48:46,045 CassandraDaemon.java 
 (line 199) Exception in thread Thread[CompactionExecutor:1149,1,main]
 java.lang.IllegalArgumentException: Illegal Capacity: -2147483648
 at java.util.ArrayList.init(ArrayList.java:142)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:182)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:194)
 at 
 org.apache.cassandra.db.SuperColumns$SCIterator.next(SuperColumns.java:138)
 at 
 org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:186)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:98)
 at 
 org.apache.cassandra.db.compaction.PrecompactedRow.init(PrecompactedRow.java:85)
 at 
 org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:196)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:74)
 at 
 org.apache.cassandra.db.compaction.CompactionIterable$Reducer.getReduced(CompactionIterable.java:55)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:115)
 at 
 org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:98)
 at 
 com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
 at 
 com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:161)
 at 
 org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
 at 
 org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:60)
 at 
 org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
 at 
 org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:198)
 at 
 java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
 {noformat}
 I've identified which sstable is causing this, it's an -ic- format sstable, 
 i.e. something written before the upgrade. I can repeat with 
 forceUserDefinedCompaction.
 Running upgradesstables also causes the same exception. 
 Scrub helps, but skips a row as incorrect. 
 I can share the sstable privately if it helps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)