[
https://issues.apache.org/jira/browse/CASSANDRA-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14732485#comment-14732485
]
Benedict commented on CASSANDRA-10274:
--------------------------------------
{{CompactionManager:291}} is not safe. We must wait for all operations to
complete whether or not there are any exceptions, as we must ensure that an
sstable remains marked compacting while any operations are running against it.
It looks to me like both of these exceptions could be explained by this bug.
Was there some other exception earlier on in the log?
> Assertion Errors when interrupting Cleanup
> ------------------------------------------
>
> Key: CASSANDRA-10274
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10274
> Project: Cassandra
> Issue Type: Bug
> Reporter: Jeff Jirsa
> Fix For: 2.1.x
>
>
> Exceptions encountered after Interrupting cleanup on 2.1.7 - logging due to
> nature. Seen on 2 different nodes. May be related to CASSANDRA-10260 .
> {code}
> INFO [CompactionExecutor:5836] 2015-09-06 11:33:39,630
> CompactionManager.java:1286 - Compaction interrupted:
> Cleanup@74bffc10-0fbe-11e5-a5ce-37a8b36fe285(keyspace, table,
> 44698243387/139158
> 624314)bytes
> INFO [CompactionExecutor:5838] 2015-09-06 11:33:39,638
> CompactionManager.java:1286 - Compaction interrupted:
> Cleanup@74bffc10-0fbe-11e5-a5ce-37a8b36fe285(keyspace, table,
> 37886026781/133123
> 638379)bytes
> INFO [CompactionExecutor:5836] 2015-09-06 11:33:39,639
> CompactionManager.java:749 - Cleaning up
> SSTableReader(path='/mnt/cassandra/data/keyspace/table-74bffc100fbe11e5a5ce37a8b36fe285/keyspace-table-26598-Data.db')
> ERROR [CompactionExecutor:5838] 2015-09-06 11:33:39,639
> CassandraDaemon.java:223 - Exception in thread
> Thread[CompactionExecutor:5838,1,main]
> java.lang.AssertionError: Memory was freed
> at
> org.apache.cassandra.io.util.SafeMemory.checkBounds(SafeMemory.java:97)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.util.Memory.getInt(Memory.java:281)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.IndexSummary.getPositionInSummary(IndexSummary.java:139)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.IndexSummary.getKey(IndexSummary.java:144)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.IndexSummary.binarySearch(IndexSummary.java:113)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.SSTableReader.getIndexScanPosition(SSTableReader.java:1183)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.SSTableReader.firstKeyBeyond(SSTableReader.java:1667)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.db.compaction.CompactionManager.needsCleanup(CompactionManager.java:693)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.db.compaction.CompactionManager.doCleanupOne(CompactionManager.java:734)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.db.compaction.CompactionManager.access$400(CompactionManager.java:94)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.db.compaction.CompactionManager$5.execute(CompactionManager.java:389)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:285)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ~[na:1.8.0_51]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> ~[na:1.8.0_51]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_51]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
> {code}
> And:
> {code}
> ERROR [IndexSummaryManager:1] 2015-09-06 09:32:23,346
> CassandraDaemon.java:223 - Exception in thread
> Thread[IndexSummaryManager:1,1,main]
> java.lang.AssertionError: null
> at
> org.apache.cassandra.io.sstable.SSTableReader.setReplacedBy(SSTableReader.java:955)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.SSTableReader.cloneAndReplace(SSTableReader.java:1002)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.SSTableReader.cloneWithNewSummarySamplingLevel(SSTableReader.java:1105)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.IndexSummaryManager.adjustSamplingLevels(IndexSummaryManager.java:421)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.IndexSummaryManager.redistributeSummaries(IndexSummaryManager.java:299)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.IndexSummaryManager.redistributeSummaries(IndexSummaryManager.java:238)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.io.sstable.IndexSummaryManager$1.runMayThrow(IndexSummaryManager.java:139)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor$UncomplainingRunnable.run(DebuggableScheduledThreadPoolExecutor.java:118)
> ~[apache-cassandra-2.1.7.jar:2.1.7]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> [na:1.8.0_51]
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> [na:1.8.0_51]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> [na:1.8.0_51]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> [na:1.8.0_51]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [na:1.8.0_51]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_51]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
> ERROR [Reference-Reaper:1] 2015-09-06 09:32:24,891 Ref.java:179 - LEAK
> DETECTED: a reference
> (org.apache.cassandra.utils.concurrent.Ref$State@56b339db) to class
> org.apache.cassandra.io.sstable.SSTableReader$InstanceTidier@1484053885:/mnt/cassandra/data/keyspace/table-74bffc100fbe11e5a5ce37a8b36fe285/keyspace-table-ka-6021
> was not released before the reference was garbage collected
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
