How major compactions are run is a bit dumb, just every 24h and it's done via a counter on each region. If you don't need them to run (let's say you don't delete stuff that much), then you can disable them and cron it to run during low traffic periods. An easy script would be:
echo "major_compact 'my_table' " | /path/to/hbase/bin/hbase shell J-D On Tue, Nov 22, 2011 at 4:12 PM, Jeff Whiting <[email protected]> wrote: > bingo that was it, thanks! The compaction queue spikes at the same time. I > also see the rpc metrics fluctuate with the major compactions (they don't go > unreasonably high but are several times slower). Is there any way to even > those out? Or prevent any compactions from impacting the rpc calls? > > ~Jeff > > On 11/22/2011 5:00 PM, Jean-Daniel Cryans wrote: >> >> Look for the compaction queue metrics, see if it fits. Could be major >> compactions. > > -- > Jeff Whiting > Qualtrics Senior Software Engineer > [email protected] > >
