[
https://issues.apache.org/jira/browse/CASSANDRA-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755439#comment-13755439
]
Piotr Kołaczkowski commented on CASSANDRA-5957:
-----------------------------------------------
Ok, I tried from cassandra-cli and it worked fine. Not sure if it was a
one-time luck so I'll try once again.
I tried once again with cqlsh and this time I got a different error:
{noformat}
INFO 08:26:10,314 Compaction interrupted:
Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
107063147/625780253)bytes
INFO 08:26:10,326 Compaction interrupted:
Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
256225944/1056670573)bytes
INFO 08:26:10,340 Compaction interrupted:
Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
256445786/533336692)bytes
INFO 08:26:10,350 Compaction interrupted:
Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
369114811/593903163)bytes
ERROR 08:26:10,415 Unable to delete
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-34-Data.db
(it will be removed on server restart; we'll also retry after GC)
ERROR 08:26:10,415 Unable to delete
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-13-Data.db
(it will be removed on server restart; we'll also retry after GC)
ERROR 08:26:10,415 Unable to delete
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-36-Data.db
(it will be removed on server restart; we'll also retry after GC)
ERROR 08:26:10,416 Unable to delete
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-23-Data.db
(it will be removed on server restart; we'll also retry after GC)
ERROR 08:26:10,416 Unable to delete
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-22-Data.db
(it will be removed on server restart; we'll also retry after GC)
INFO 08:26:10,416 Compaction interrupted:
Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
794619126/1234742593)bytes
INFO 08:26:10,548 Compaction interrupted:
Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
186316188/523663644)bytes
INFO 08:26:10,604 Compaction interrupted:
Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
495853724/605444868)bytes
ERROR 08:26:10,618 Unable to delete
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-30-Data.db
(it will be removed on server restart; we'll also retry after GC)
ERROR 08:26:10,627 Unable to delete
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-15-Data.db
(it will be removed on server restart; we'll also retry after GC)
ERROR 08:26:10,627 Unable to delete
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-14-Data.db
(it will be removed on server restart; we'll also retry after GC)
ERROR 08:26:10,639 Unable to delete
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-29-Data.db
(it will be removed on server restart; we'll also retry after GC)
INFO 08:26:10,793 Completed flushing
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-92-Data.db
(24952067 bytes) for commitlog position ReplayPosition(segmentId=1377929629788,
position=10887214)
INFO 08:26:10,802 Compacting
[SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-57-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-83-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-92-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-55-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-91-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-74-Data.db')]
INFO 08:26:10,805 Compacted 4 sstables to
[/var/lib/cassandra/data/system/schema_keyspaces/system-schema_keyspaces-ic-5,].
529 bytes to 249 (~47% of original) in 872ms = 0,000272MB/s. 6 total rows, 3
unique. Row merge counts were {1:2, 2:0, 3:0, 4:1, }
INFO 08:26:10,810 Compacting
[SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-48-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-52-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-62-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-68-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-87-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-65-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-31-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-33-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-81-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-45-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-28-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-66-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-69-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-25-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-19-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-21-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-88-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-58-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-84-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-61-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-78-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-72-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-73-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-75-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-64-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-59-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-24-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-46-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-76-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-60-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-80-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-79-Data.db')]
INFO 08:26:10,813 Compacting
[SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-40-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-56-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-10-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-8-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-50-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-86-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-67-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-49-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-44-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-85-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-26-Data.db')]
ERROR 08:26:10,815 Exception in thread Thread[CompactionExecutor:4,1,main]
java.lang.RuntimeException: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-31-Data.db
(No such file or directory)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:53)
at
org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1212)
at
org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:54)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1032)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1044)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:157)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:163)
at
org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:117)
at
org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:58)
at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:60)
at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:208)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-31-Data.db
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:216)
at
org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:67)
at
org.apache.cassandra.io.util.ThrottledReader.<init>(ThrottledReader.java:35)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:49)
... 18 more
ERROR 08:26:10,815 Exception in thread Thread[CompactionExecutor:5,1,main]
java.lang.RuntimeException: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-10-Data.db
(No such file or directory)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:53)
at
org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1212)
at
org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:54)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1032)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1044)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:157)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:163)
at
org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:117)
at
org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:58)
at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:60)
at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:208)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-10-Data.db
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:216)
at
org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:67)
at
org.apache.cassandra.io.util.ThrottledReader.<init>(ThrottledReader.java:35)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:49)
... 18 more
INFO 08:26:10,821 Compacting
[SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-48-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-52-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-62-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-68-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-87-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-65-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-31-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-33-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-81-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-45-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-28-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-66-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-69-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-25-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-19-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-21-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-88-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-58-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-84-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-61-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-78-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-72-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-73-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-75-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-64-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-59-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-24-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-46-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-76-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-60-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-80-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-79-Data.db')]
ERROR 08:26:10,822 Exception in thread Thread[CompactionExecutor:8,1,main]
java.lang.RuntimeException: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-31-Data.db
(No such file or directory)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:53)
at
org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1212)
at
org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:54)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1032)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1044)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:157)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:163)
at
org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:117)
at
org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:58)
at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:60)
at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:208)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-31-Data.db
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:216)
at
org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:67)
at
org.apache.cassandra.io.util.ThrottledReader.<init>(ThrottledReader.java:35)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:49)
... 18 more
ERROR 08:26:10,862 Exception in thread Thread[MigrationStage:1,5,main]
java.lang.RuntimeException: Tried to hard link to file that does not exist
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-28-Index.db
at
org.apache.cassandra.io.util.FileUtils.createHardLink(FileUtils.java:72)
at
org.apache.cassandra.io.sstable.SSTableReader.createLinks(SSTableReader.java:1081)
at
org.apache.cassandra.db.ColumnFamilyStore.snapshotWithoutFlush(ColumnFamilyStore.java:1567)
at
org.apache.cassandra.db.ColumnFamilyStore.snapshot(ColumnFamilyStore.java:1612)
at
org.apache.cassandra.db.DefsTable.dropColumnFamily(DefsTable.java:608)
at
org.apache.cassandra.db.DefsTable.mergeColumnFamilies(DefsTable.java:471)
at org.apache.cassandra.db.DefsTable.mergeSchema(DefsTable.java:356)
at
org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:304)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
ERROR 08:26:10,863 Error occurred during processing of message.
java.lang.RuntimeException: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: Tried to hard link to file that does not exist
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-28-Index.db
at
org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:379)
at
org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:286)
at
org.apache.cassandra.service.MigrationManager.announceKeyspaceDrop(MigrationManager.java:267)
at
org.apache.cassandra.cql.QueryProcessor.processStatement(QueryProcessor.java:718)
at
org.apache.cassandra.cql.QueryProcessor.process(QueryProcessor.java:775)
at
org.apache.cassandra.thrift.CassandraServer.execute_cql_query(CassandraServer.java:1668)
at
org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:4048)
at
org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:4036)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
at
org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:199)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException:
Tried to hard link to file that does not exist
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-28-Index.db
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
at java.util.concurrent.FutureTask.get(FutureTask.java:83)
at
org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:375)
... 13 more
Caused by: java.lang.RuntimeException: Tried to hard link to file that does not
exist
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-28-Index.db
at
org.apache.cassandra.io.util.FileUtils.createHardLink(FileUtils.java:72)
at
org.apache.cassandra.io.sstable.SSTableReader.createLinks(SSTableReader.java:1081)
at
org.apache.cassandra.db.ColumnFamilyStore.snapshotWithoutFlush(ColumnFamilyStore.java:1567)
at
org.apache.cassandra.db.ColumnFamilyStore.snapshot(ColumnFamilyStore.java:1612)
at
org.apache.cassandra.db.DefsTable.dropColumnFamily(DefsTable.java:608)
at
org.apache.cassandra.db.DefsTable.mergeColumnFamilies(DefsTable.java:471)
at org.apache.cassandra.db.DefsTable.mergeSchema(DefsTable.java:356)
at
org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:304)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
... 3 more
INFO 08:26:19,760 Compacted 6 sstables to
[/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-93,]. 137
181 408 bytes to 137 181 408 (~100% of original) in 8 958ms = 14,604419MB/s. 1
248 total rows, 1 248 unique. Row merge counts were {1:1248, 2:0, 3:0, 4:0,
5:0, 6:0, }
INFO 08:26:19,765 Compacting
[SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-40-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-56-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-10-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-8-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-50-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-86-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-67-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-49-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-44-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-85-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-26-Data.db')]
ERROR 08:26:19,765 Exception in thread Thread[CompactionExecutor:2,1,main]
java.lang.RuntimeException: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-10-Data.db
(No such file or directory)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:53)
at
org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1212)
at
org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:54)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1032)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1044)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:157)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:163)
at
org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:117)
at
org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:58)
at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:60)
at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:208)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-10-Data.db
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:216)
at
org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:67)
at
org.apache.cassandra.io.util.ThrottledReader.<init>(ThrottledReader.java:35)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:49)
... 18 more
INFO 08:26:19,766 Compacting
[SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-48-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-52-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-62-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-68-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-87-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-65-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-31-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-33-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-81-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-45-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-28-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-66-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-69-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-25-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-19-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-21-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-88-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-58-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-84-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-61-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-78-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-72-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-73-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-75-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-64-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-59-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-24-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-46-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-76-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-60-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-80-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-79-Data.db')]
INFO 08:26:19,769 Compacting
[SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-40-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-56-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-10-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-8-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-50-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-86-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-67-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-49-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-44-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-85-Data.db'),
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-26-Data.db')]
ERROR 08:26:19,769 Exception in thread Thread[CompactionExecutor:3,1,main]
java.lang.RuntimeException: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-31-Data.db
(No such file or directory)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:53)
at
org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1212)
at
org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:54)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1032)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1044)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:157)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:163)
at
org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:117)
at
org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:58)
at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:60)
at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:208)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-31-Data.db
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:216)
at
org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:67)
at
org.apache.cassandra.io.util.ThrottledReader.<init>(ThrottledReader.java:35)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:49)
... 18 more
ERROR 08:26:19,771 Exception in thread Thread[CompactionExecutor:1,1,main]
java.lang.RuntimeException: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-10-Data.db
(No such file or directory)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:53)
at
org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1212)
at
org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:54)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1032)
at
org.apache.cassandra.io.sstable.SSTableReader.getDirectScanner(SSTableReader.java:1044)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:157)
at
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.getScanners(AbstractCompactionStrategy.java:163)
at
org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:117)
at
org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:58)
at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:60)
at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:208)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.FileNotFoundException:
/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-10-Data.db
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:216)
at
org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:67)
at
org.apache.cassandra.io.util.ThrottledReader.<init>(ThrottledReader.java:35)
at
org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:49)
... 18 more
{noformat}
> Cannot drop keyspace Keyspace1 after running cassandra-stress
> -------------------------------------------------------------
>
> Key: CASSANDRA-5957
> URL: https://issues.apache.org/jira/browse/CASSANDRA-5957
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Environment: Cassandra 1.2.9 freshly built from cassandra-1.2 branch
> (f5b224cf9aa0f319d51078ef4b78d55e36613963)
> Reporter: Piotr Kołaczkowski
> Assignee: Aleksey Yeschenko
> Priority: Minor
> Fix For: 1.2.10
>
>
> Steps to reproduce:
> # Set MAX_HEAP="2G", HEAP_NEWSIZE="400M"
> # Run ./cassandra-stress -n 50000 -c 400 -S 256
> # The test should complete despite several warnings about low heap memory.
> # Try to drop keyspace:
> {noformat}
> cqlsh> drop keyspace Keyspace1;
> TSocket read 0 bytes
> {noformat}
> system.log:
> {noformat}
> INFO 15:10:46,516 Enqueuing flush of
> Memtable-schema_columnfamilies@2127258371(0/0 serialized/live bytes, 1 ops)
> INFO 15:10:46,516 Writing Memtable-schema_columnfamilies@2127258371(0/0
> serialized/live bytes, 1 ops)
> INFO 15:10:46,690 Completed flushing
> /var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ic-6-Data.db
> (38 bytes) for commitlog position ReplayPosition(segmentId=1377867520699,
> position=19794574)
> INFO 15:10:46,692 Enqueuing flush of Memtable-schema_columns@1997964959(0/0
> serialized/live bytes, 1 ops)
> INFO 15:10:46,693 Writing Memtable-schema_columns@1997964959(0/0
> serialized/live bytes, 1 ops)
> INFO 15:10:46,857 Completed flushing
> /var/lib/cassandra/data/system/schema_columns/system-schema_columns-ic-6-Data.db
> (38 bytes) for commitlog position ReplayPosition(segmentId=1377867520699,
> position=19794574)
> INFO 15:10:46,897 Enqueuing flush of Memtable-local@1366216652(98/98
> serialized/live bytes, 3 ops)
> INFO 15:10:46,898 Writing Memtable-local@1366216652(98/98 serialized/live
> bytes, 3 ops)
> INFO 15:10:47,064 Completed flushing
> /var/lib/cassandra/data/system/local/system-local-ic-12-Data.db (139 bytes)
> for commitlog position ReplayPosition(segmentId=1377867520699,
> position=19794845)
> INFO 15:10:48,956 Enqueuing flush of Memtable-local@432522279(46/46
> serialized/live bytes, 1 ops)
> INFO 15:10:48,957 Writing Memtable-local@432522279(46/46 serialized/live
> bytes, 1 ops)
> INFO 15:10:49,132 Compaction interrupted:
> Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
> 400882073/1094043713)bytes
> INFO 15:10:49,175 Compaction interrupted:
> Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
> 147514075/645675954)bytes
> INFO 15:10:49,185 Compaction interrupted:
> Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
> 223249644/609072261)bytes
> INFO 15:10:49,202 Compaction interrupted:
> Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
> 346471085/990388210)bytes
> INFO 15:10:49,215 Compaction interrupted:
> Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
> 294748503/2092376617)bytes
> INFO 15:10:49,257 Compaction interrupted:
> Compaction@4d331c44-f018-302b-91c2-2dcf94c4bfad(Keyspace1, Standard1,
> 692722235/739328646)bytes
> INFO 15:10:49,285 Completed flushing
> /var/lib/cassandra/data/system/local/system-local-ic-13-Data.db (82 bytes)
> for commitlog position ReplayPosition(segmentId=1377867520699,
> position=19794974)
> INFO 15:10:49,286 Compacting
> [SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-ic-10-Data.db'),
>
> SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-ic-13-Data.db'),
>
> SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-ic-12-Data.db'),
>
> SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-ic-11-Data.db')]
> ERROR 15:10:49,287 Error occurred during processing of message.
> java.lang.RuntimeException: java.util.concurrent.ExecutionException:
> java.lang.AssertionError:
> SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-78-Data.db')
> was already marked compacted
> at
> org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:378)
> at
> org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:281)
> at
> org.apache.cassandra.service.MigrationManager.announceKeyspaceDrop(MigrationManager.java:262)
> at
> org.apache.cassandra.cql.QueryProcessor.processStatement(QueryProcessor.java:718)
> at
> org.apache.cassandra.cql.QueryProcessor.process(QueryProcessor.java:775)
> at
> org.apache.cassandra.thrift.CassandraServer.execute_cql_query(CassandraServer.java:1668)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:4048)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:4036)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
> at
> org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:199)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError:
> SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-78-Data.db')
> was already marked compacted
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at
> org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:374)
> ... 13 more
> Caused by: java.lang.AssertionError:
> SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-78-Data.db')
> was already marked compacted
> at
> org.apache.cassandra.db.DataTracker.removeOldSSTablesSize(DataTracker.java:354)
> at org.apache.cassandra.db.DataTracker.postReplace(DataTracker.java:325)
> at
> org.apache.cassandra.db.DataTracker.unreferenceSSTables(DataTracker.java:264)
> at
> org.apache.cassandra.db.ColumnFamilyStore.invalidate(ColumnFamilyStore.java:302)
> at org.apache.cassandra.db.Table.unloadCf(Table.java:314)
> at org.apache.cassandra.db.Table.dropCf(Table.java:296)
> at
> org.apache.cassandra.db.DefsTable.dropColumnFamily(DefsTable.java:607)
> at
> org.apache.cassandra.db.DefsTable.mergeColumnFamilies(DefsTable.java:469)
> at org.apache.cassandra.db.DefsTable.mergeSchema(DefsTable.java:355)
> at
> org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:299)
> at
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
> ERROR 15:10:49,287 Exception in thread Thread[MigrationStage:1,5,main]
> java.lang.AssertionError:
> SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-ic-78-Data.db')
> was already marked compacted
> at
> org.apache.cassandra.db.DataTracker.removeOldSSTablesSize(DataTracker.java:354)
> at org.apache.cassandra.db.DataTracker.postReplace(DataTracker.java:325)
> at
> org.apache.cassandra.db.DataTracker.unreferenceSSTables(DataTracker.java:264)
> at
> org.apache.cassandra.db.ColumnFamilyStore.invalidate(ColumnFamilyStore.java:302)
> at org.apache.cassandra.db.Table.unloadCf(Table.java:314)
> at org.apache.cassandra.db.Table.dropCf(Table.java:296)
> at
> org.apache.cassandra.db.DefsTable.dropColumnFamily(DefsTable.java:607)
> at
> org.apache.cassandra.db.DefsTable.mergeColumnFamilies(DefsTable.java:469)
> at org.apache.cassandra.db.DefsTable.mergeSchema(DefsTable.java:355)
> at
> org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:299)
> at
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> at java.lang.Thread.run(Thread.java:662)
> INFO 15:10:49,471 Compacted 4 sstables to
> [/var/lib/cassandra/data/system/local/system-local-ic-14,]. 829 bytes to 501
> (~60% of original) in 184ms = 0,002597MB/s. 4 total rows, 1 unique. Row
> merge counts were {1:0, 2:0, 3:0, 4:1, }
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
