[jira] [Commented] (CASSANDRA-7803) When compaction is interrupted, it leaves locked, undeletable files

2014-08-21 Thread Benedict (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105184#comment-14105184
 ] 

Benedict commented on CASSANDRA-7803:
-

LGTM, +1

 When compaction is interrupted, it leaves locked, undeletable files
 ---

 Key: CASSANDRA-7803
 URL: https://issues.apache.org/jira/browse/CASSANDRA-7803
 Project: Cassandra
  Issue Type: Bug
  Components: Core
 Environment: RedHat, xfs4, JNA enabled, JBOD,
Reporter: Scooletz
Assignee: Marcus Eriksson
  Labels: compaction
 Fix For: 2.1.0

 Attachments: 0001-dont-try-to-remove-fake-FINAL-files.patch


 During tests of new features of 2.1 like: 
 - incremental repairs 
 - leveled compaction
 I interrupted a compaction, which left the following ERROR in the _system.log_
 {quote}
 org.apache.cassandra.db.compaction.CompactionInterruptedException: Compaction 
 interrupted: Compaction@152e6e70-1975-11e4-ba09-61f0d75c60c6(xx, xxx, 
 378505918/1993581634)bytes
   at 
 org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:174)
   at 
 org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
   at 
 org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
   at 
 org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:74)
   at 
 org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
   at 
 org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:235)
   at 
 java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 
 ~[na:1.7.0_09]
   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) 
 ~[na:1.7.0_09]
   at java.util.concurrent.FutureTask.run(FutureTask.java:166) 
 ~[na:1.7.0_09]
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  ~[na:1.7.0_09]
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  [na:1.7.0_09]
   at java.lang.Thread.run(Thread.java:722) [na:1.7.0_09]
 {quote}
 Right after that, a cascade of reoccurring errors was being emitted till the 
 restart:
 {quote}
 ERROR [NonPeriodicTasks:1] 2014-08-19 13:38:41,258 
 SSTableDeletingTask.java:81 - Unable to delete 
 /grid/data04/cassandra/data/xx/xxx-152e6e70197511e4ba0961f0d75c60c6/xx-xxx-ka-55058-Data.db
  (it will be removed on server restart; we'll also retry after GC)
 {quote}
 which made this node blinking (noted from the other nodes gossiper log 
 entries).
 After restart, the node is healthy and fully operational.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Commented] (CASSANDRA-7803) When compaction is interrupted, it leaves locked, undeletable files

2014-08-20 Thread Jonathan Ellis (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103950#comment-14103950
 ] 

Jonathan Ellis commented on CASSANDRA-7803:
---

Not sure if this is related to the incremental paging-in of compaction results, 
or if it might affect 2.0 as well.

 When compaction is interrupted, it leaves locked, undeletable files
 ---

 Key: CASSANDRA-7803
 URL: https://issues.apache.org/jira/browse/CASSANDRA-7803
 Project: Cassandra
  Issue Type: Bug
  Components: Core
 Environment: RedHat, xfs4, JNA enabled, JBOD,
Reporter: Scooletz
Assignee: Marcus Eriksson
  Labels: Comparator
 Fix For: 2.1.1


 During tests of new features of 2.1 like: 
 - incremental repairs 
 - leveled compaction
 I interrupted a compaction, which left the following ERROR in the _system.log_
 {quote}
 org.apache.cassandra.db.compaction.CompactionInterruptedException: Compaction 
 interrupted: Compaction@152e6e70-1975-11e4-ba09-61f0d75c60c6(xx, xxx, 
 378505918/1993581634)bytes
   at 
 org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:174)
   at 
 org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
   at 
 org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
   at 
 org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:74)
   at 
 org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
   at 
 org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:235)
   at 
 java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 
 ~[na:1.7.0_09]
   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) 
 ~[na:1.7.0_09]
   at java.util.concurrent.FutureTask.run(FutureTask.java:166) 
 ~[na:1.7.0_09]
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  ~[na:1.7.0_09]
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  [na:1.7.0_09]
   at java.lang.Thread.run(Thread.java:722) [na:1.7.0_09]
 {quote}
 Right after that, a cascade of reoccurring errors was being emitted till the 
 restart:
 {quote}
 ERROR [NonPeriodicTasks:1] 2014-08-19 13:38:41,258 
 SSTableDeletingTask.java:81 - Unable to delete 
 /grid/data04/cassandra/data/xx/xxx-152e6e70197511e4ba0961f0d75c60c6/xx-xxx-ka-55058-Data.db
  (it will be removed on server restart; we'll also retry after GC)
 {quote}
 which made this node blinking (noted from the other nodes gossiper log 
 entries).
 After restart, the node is healthy and fully operational.



--
This message was sent by Atlassian JIRA
(v6.2#6252)