Re: Nodetool cleanup takes long time and no progress
You can check for progress using `nodetool compactionstats` (which will show Cleanup tasks), or check for ‘Cleaned up’ messages in the log (/var/log/cassandra/system.log). However, `nodetool cleanup` has a very specific and limited task - it deletes data no longer owned by the node, typically after adding nodes or moving tokens. Have you done that recently? Or are you trying to clean up space after issuing a lot of deletes? On 7/24/15, 3:55 PM, rock zhang r...@alohar.com wrote: Hi All, After I added node, I run node tool cleanup on the old notes , but it takes forever, no error message, and I don't see space are freed. What should I do ? Repair first ? Thanks Rock smime.p7s Description: S/MIME cryptographic signature
Re: Nodetool cleanup takes long time and no progress
Hi Jeff, It already 2 hours, only progress is 6%, seems it is very slow. Is there any way to speedup ? If I interrupted the process, what gonna happen ? Next time it just compact again, right ? I think by default setting is the compaction occurs every day . Thanks Rock On Jul 24, 2015, at 4:58 PM, rock zhang r...@alohar.com wrote: Thank you Jeff. I just added one more node, so i want to delete moved tokens. ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1413 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 25817918778 500823247199 bytes 5.16% Cleanuprawdata raw_data 27060645 45183439 bytes 59.89% Active compaction remaining time : 0h00m00s ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1410 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 25911965212 500823247199 bytes 5.17% Cleanuprawdata raw_data 11783629 43660120 bytes 26.99% Active compaction remaining time : 0h00m00s ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1406 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 5767168 45595353 bytes 12.65% Cleanuprawdata raw_data 26091690659 500823247199 bytes 5.21% Active compaction remaining time : 0h00m00s ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1406 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 35078225 45595353 bytes 76.93% Cleanuprawdata raw_data 26119307264 500823247199 bytes 5.22% Active compaction remaining time : 0h00m00s On Jul 24, 2015, at 4:04 PM, Jeff Jirsa jeff.ji...@crowdstrike.com wrote: You can check for progress using `nodetool compactionstats` (which will show Cleanup tasks), or check for ‘Cleaned up’ messages in the log (/var/log/cassandra/system.log). However, `nodetool cleanup` has a very specific and limited task - it deletes data no longer owned by the node, typically after adding nodes or moving tokens. Have you done that recently? Or are you trying to clean up space after issuing a lot of deletes? On 7/24/15, 3:55 PM, rock zhang r...@alohar.com wrote: Hi All, After I added node, I run node tool cleanup on the old notes , but it takes forever, no error message, and I don't see space are freed. What should I do ? Repair first ? Thanks Rock
Re: Nodetool cleanup takes long time and no progress
On Fri, Jul 24, 2015 at 5:03 PM, rock zhang r...@alohar.com wrote: It already 2 hours, only progress is 6%, seems it is very slow. Is there any way to speedup ? Cleanup is a type of compaction; it obeys the compaction throttle. If I interrupted the process, what gonna happen ? Next time it just compact again, right ? Cleanup is never automatically triggered. Also, I doubt that it will be trivial for you to interrupt it. I think by default setting is the compaction occurs every day . This doesn't parse for me. Minor compaction is continuous if the node is receiving write traffic. =Rob
Re: Nodetool cleanup takes long time and no progress
Thank you Jeff. I just added one more node, so i want to delete moved tokens. ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1413 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 25817918778 500823247199 bytes 5.16% Cleanuprawdata raw_data 27060645 45183439 bytes 59.89% Active compaction remaining time : 0h00m00s ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1410 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 25911965212 500823247199 bytes 5.17% Cleanuprawdata raw_data 11783629 43660120 bytes 26.99% Active compaction remaining time : 0h00m00s ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1406 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 5767168 45595353 bytes 12.65% Cleanuprawdata raw_data 26091690659 500823247199 bytes 5.21% Active compaction remaining time : 0h00m00s ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1406 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 35078225 45595353 bytes 76.93% Cleanuprawdata raw_data 26119307264 500823247199 bytes 5.22% Active compaction remaining time : 0h00m00s On Jul 24, 2015, at 4:04 PM, Jeff Jirsa jeff.ji...@crowdstrike.com wrote: You can check for progress using `nodetool compactionstats` (which will show Cleanup tasks), or check for ‘Cleaned up’ messages in the log (/var/log/cassandra/system.log). However, `nodetool cleanup` has a very specific and limited task - it deletes data no longer owned by the node, typically after adding nodes or moving tokens. Have you done that recently? Or are you trying to clean up space after issuing a lot of deletes? On 7/24/15, 3:55 PM, rock zhang r...@alohar.com wrote: Hi All, After I added node, I run node tool cleanup on the old notes , but it takes forever, no error message, and I don't see space are freed. What should I do ? Repair first ? Thanks Rock
