To date I have used the major / minor compaction threads to control how many compactions are allowed to exist at one time on a per RegionServer basis. Then compact a table, and have the threads control how many regions can compact at once. With care taken if minors are upgraded to majors as there is no throttling on Disk IO for majors which can be very impactful.
Aravind created an offline compaction script which pre-dated the threading implementation which you may find useful. https://github.com/aravind/hbase_compact On Tue, Nov 6, 2012 at 10:38 AM, Otis Gospodnetic < [email protected]> wrote: > Hi, > > Major compactions are..... you know... :) > So I saw there is https://issues.apache.org/jira/browse/HBASE-3743 for > throttling them. > > We are about to try the per-region compaction, so I was wondering if anyone > has written a tool/script to automate that a bit? > > Thanks, > Otis > -- > Search Analytics - http://sematext.com/search-analytics/index.html > Performance Monitoring - http://sematext.com/spm/index.html >
