I was thinking whether coprocessors framework can be used to do such house keeping jobs: how loaded is a region, how many scan/put/get operations, etc (as there are pre-post of almost all possible operations at region level ( in this case client side operations via RegionObserver interface). or may be me being 'microscopically' focussed on that framework :-))
Himanshu On Wed, Nov 17, 2010 at 9:15 AM, Lars George <[email protected]> wrote: > JD, > > Should we create a metric for it so that it dynamically counts per > region its usage? That can then be exposed via Ganglia context or JMX. > Just wondering. > > Lars > > On Wed, Nov 17, 2010 at 5:04 PM, Vaibhav Puranik <[email protected]> > wrote: > > hi, > > > > Thanks for the suggestions JD & Michael. > > The region servers serving ROOT & META regions are fine. > > > > I will try analysing tcpdump output. > > > > Regards, > > Vaibhav > > GumGum > > > > > > > > On Tue, Nov 16, 2010 at 7:15 AM, Michael Segel < > [email protected]>wrote: > > > >> > >> Beyond this... which region is serving your ROOT and meta data? > >> > >> That node will probably get a higher load. > >> Also, how many disks do you have and how many nodes? > >> You could see higher CPU loads if you're I/O bound. > >> > >> > Date: Mon, 15 Nov 2010 18:24:31 -0800 > >> > Subject: Re: Correlating traffic with regions > >> > From: [email protected] > >> > To: [email protected] > >> > > >> > Yeah this is one area where HBase could do a much better job... > >> > because there's not really a way to do it within the database. One > >> > thing you can do is to tcpdump a few seconds of traffic on that node > >> > and decipher which tables (shown in the region name) are being used. > >> > > >> > J-D > >> > > >> > On Mon, Nov 15, 2010 at 5:17 PM, Vaibhav Puranik <[email protected]> > >> wrote: > >> > > Hi all, > >> > > > >> > > We are running 0.20.6 in production. > >> > > > >> > > On one of our nodes, we are seeing CPU (all 8 CPUS) hovering near > 60%. > >> But > >> > > the node has many tables and many regions on it. > >> > > > >> > > Is there an easy way to find out which of these regions or tables > are > >> > > getting most of the traffic? > >> > > > >> > > Regards, > >> > > Vaibhav Purnaik > >> > > GumGum > >> > > > >> > >> > > >
