[ 
https://issues.apache.org/jira/browse/CASSANDRA-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13575055#comment-13575055
 ] 

Michael Kjellman commented on CASSANDRA-5151:
---------------------------------------------

wondering if this is related...

{code}
 INFO 18:43:25,360 Completed flushing 
/data/cassandra/system/compactions_in_progress/system-compactions_in_progress-ib-60-Data.db
 (192 bytes) for commitlog position ReplayPosition(segmentId=1360374628064, 
position=29215408)
 INFO 18:43:25,364 Compacting 
[SSTableReader(path='/var/lib/cassandra/data/evidence/fingerprints/evidence-fingerprints-ib-2182-Data.db'),
 
SSTableReader(path='/var/lib/cassandra/data/evidence/fingerprints/evidence-fingerprints-ib-2180-Data.db'),
 
SSTableReader(path='/var/lib/cassandra/data/evidence/fingerprints/evidence-fingerprints-ib-2185-Data.db'),
 
SSTableReader(path='/data/cassandra/evidence/fingerprints/evidence-fingerprints-ib-2181-Data.db'),
 
SSTableReader(path='/data/cassandra/evidence/fingerprints/evidence-fingerprints-ib-2184-Data.db'),
 
SSTableReader(path='/var/lib/cassandra/data/evidence/fingerprints/evidence-fingerprints-ib-2183-Data.db'),
 
SSTableReader(path='/var/lib/cassandra/data/evidence/fingerprints/evidence-fingerprints-ib-2179-Data.db')]
ERROR 18:43:25,367 Exception in thread Thread[CompactionExecutor:85,1,main]
java.lang.RuntimeException: java.io.FileNotFoundException: 
/var/lib/cassandra/data/evidence/fingerprints/evidence-fingerprints-ib-2183-Data.db
 (No such file or directory)
        at 
org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:61)
        at 
org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1121)
        at 
org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:51)
        at 
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:954)
        at 
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:966)
        at 
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:147)
        at 
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:153)
        at 
org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:124)
        at 
org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
        at 
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
        at 
org.apache.cassandra.db.compaction.CompactionTask.execute(CompactionTask.java:63)
        at 
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:193)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)
Caused by: java.io.FileNotFoundException: 
/var/lib/cassandra/data/evidence/fingerprints/evidence-fingerprints-ib-2183-Data.db
 (No such file or directory)
        at java.io.RandomAccessFile.open(Native Method)
        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
        at 
org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:67)
        at 
org.apache.cassandra.io.compress.CompressedRandomAccessReader.<init>(CompressedRandomAccessReader.java:78)
        at 
org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:57)
        ... 17 more
{code}
                
> Implement better way of eliminating compaction left overs.
> ----------------------------------------------------------
>
>                 Key: CASSANDRA-5151
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-5151
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.1.3
>            Reporter: Yuki Morishita
>            Assignee: Yuki Morishita
>             Fix For: 1.2.2
>
>         Attachments: 5151-1.2.txt, 5151-v2.txt
>
>
> This is from discussion in CASSANDRA-5137. Currently we skip loading SSTables 
> that are left over from incomplete compaction to not over-count counter, but 
> the way we track compaction completion is not secure.
> One possible solution is to create system CF like:
> {code}
> create table compaction_log (
>   id uuid primary key,
>   inputs set<int>,
>   outputs set<int>
> );
> {code}
> to track incomplete compaction.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to