Re: Nodetool cleanup takes long time and no progress
On Fri, Jul 24, 2015 at 5:03 PM, rock zhang wrote: > It already 2 hours, only progress is 6%, seems it is very slow. Is there > any way to speedup ? > Cleanup is a type of compaction; it obeys the compaction throttle. > If I interrupted the process, what gonna happen ? Next time it just > compact again, right ? > Cleanup is never automatically triggered. Also, I doubt that it will be trivial for you to interrupt it. > I think by default setting is the compaction occurs every day . > This doesn't parse for me. Minor compaction is continuous if the node is receiving write traffic. =Rob
Re: Nodetool cleanup takes long time and no progress
Hi Jeff, It already 2 hours, only progress is 6%, seems it is very slow. Is there any way to speedup ? If I interrupted the process, what gonna happen ? Next time it just compact again, right ? I think by default setting is the compaction occurs every day . Thanks Rock On Jul 24, 2015, at 4:58 PM, rock zhang wrote: > Thank you Jeff. I just added one more node, so i want to delete moved tokens. > > ubuntu@ip-172-31-30-145:~$ nodetool compactionstats > pending tasks: 1413 >compaction type keyspace table completed totalunit > progress >Cleanuprawdata raw_data 25817918778 500823247199 bytes > 5.16% >Cleanuprawdata raw_data 27060645 45183439 bytes > 59.89% > Active compaction remaining time : 0h00m00s > ubuntu@ip-172-31-30-145:~$ nodetool compactionstats > pending tasks: 1410 >compaction type keyspace table completed totalunit > progress >Cleanuprawdata raw_data 25911965212 500823247199 bytes > 5.17% >Cleanuprawdata raw_data 11783629 43660120 bytes > 26.99% > Active compaction remaining time : 0h00m00s > ubuntu@ip-172-31-30-145:~$ nodetool compactionstats > pending tasks: 1406 >compaction type keyspace table completed totalunit > progress >Cleanuprawdata raw_data 5767168 45595353 bytes > 12.65% >Cleanuprawdata raw_data 26091690659 500823247199 bytes > 5.21% > Active compaction remaining time : 0h00m00s > ubuntu@ip-172-31-30-145:~$ nodetool compactionstats > pending tasks: 1406 >compaction type keyspace table completed totalunit > progress >Cleanuprawdata raw_data 35078225 45595353 bytes > 76.93% >Cleanuprawdata raw_data 26119307264 500823247199 bytes > 5.22% > Active compaction remaining time : 0h00m00s > > > > > On Jul 24, 2015, at 4:04 PM, Jeff Jirsa wrote: > >> You can check for progress using `nodetool compactionstats` (which will show >> Cleanup tasks), or check for ‘Cleaned up’ messages in the log >> (/var/log/cassandra/system.log). >> >> However, `nodetool cleanup` has a very specific and limited task - it >> deletes data no longer owned by the node, typically after adding nodes or >> moving tokens. Have you done that recently? Or are you trying to clean up >> space after issuing a lot of deletes? >> >> >> >> >> >> On 7/24/15, 3:55 PM, "rock zhang" wrote: >> >>> Hi All, >>> >>> After I added node, I run node tool cleanup on the old notes , but it takes >>> forever, no error message, and I don't see space are freed. >>> >>> What should I do ? Repair first ? >>> >>> Thanks >>> Rock >
Re: Nodetool cleanup takes long time and no progress
Thank you Jeff. I just added one more node, so i want to delete moved tokens. ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1413 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 25817918778 500823247199 bytes 5.16% Cleanuprawdata raw_data 27060645 45183439 bytes 59.89% Active compaction remaining time : 0h00m00s ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1410 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 25911965212 500823247199 bytes 5.17% Cleanuprawdata raw_data 11783629 43660120 bytes 26.99% Active compaction remaining time : 0h00m00s ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1406 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 5767168 45595353 bytes 12.65% Cleanuprawdata raw_data 26091690659 500823247199 bytes 5.21% Active compaction remaining time : 0h00m00s ubuntu@ip-172-31-30-145:~$ nodetool compactionstats pending tasks: 1406 compaction type keyspace table completed totalunit progress Cleanuprawdata raw_data 35078225 45595353 bytes 76.93% Cleanuprawdata raw_data 26119307264 500823247199 bytes 5.22% Active compaction remaining time : 0h00m00s On Jul 24, 2015, at 4:04 PM, Jeff Jirsa wrote: > You can check for progress using `nodetool compactionstats` (which will show > Cleanup tasks), or check for ‘Cleaned up’ messages in the log > (/var/log/cassandra/system.log). > > However, `nodetool cleanup` has a very specific and limited task - it deletes > data no longer owned by the node, typically after adding nodes or moving > tokens. Have you done that recently? Or are you trying to clean up space > after issuing a lot of deletes? > > > > > > On 7/24/15, 3:55 PM, "rock zhang" wrote: > >> Hi All, >> >> After I added node, I run node tool cleanup on the old notes , but it takes >> forever, no error message, and I don't see space are freed. >> >> What should I do ? Repair first ? >> >> Thanks >> Rock
Re: Nodetool cleanup takes long time and no progress
You can check for progress using `nodetool compactionstats` (which will show Cleanup tasks), or check for ‘Cleaned up’ messages in the log (/var/log/cassandra/system.log). However, `nodetool cleanup` has a very specific and limited task - it deletes data no longer owned by the node, typically after adding nodes or moving tokens. Have you done that recently? Or are you trying to clean up space after issuing a lot of deletes? On 7/24/15, 3:55 PM, "rock zhang" wrote: >Hi All, > >After I added node, I run node tool cleanup on the old notes , but it takes >forever, no error message, and I don't see space are freed. > >What should I do ? Repair first ? > >Thanks >Rock smime.p7s Description: S/MIME cryptographic signature
Nodetool cleanup takes long time and no progress
Hi All, After I added node, I run node tool cleanup on the old notes , but it takes forever, no error message, and I don't see space are freed. What should I do ? Repair first ? Thanks Rock
