Do you have 100% data locality ? How is the network trafic ?
On Wed, Jan 2, 2013 at 7:07 AM, Ted Yu <[email protected]> wrote: > bq. It took about 6h to complete. > > If the above behavior is reproducible, we should investigate more deeply. > > Thanks for sharing. > > On Tue, Jan 1, 2013 at 6:14 PM, Jean-Marc Spaggiari < > [email protected] > > wrote: > > > Yes, I'm running on 0.94.3. The last major compaction ran yesterday. > > It's almost daily. That's why I was surprise it took so long. I mean, > > I'm only compacting regions who moved. So it should be pretty quick. > > But was not the case. It took about 6h to complete. Strange. Maybe > > something went wrong when I stopped/started hbase. > > > > also, there was almost no activity on the network nor on the CPUs. I > > will have to add disks monitoring on Ganglia to see if I was limited > > by IOs... > > > > I looked at the regions logs and everything was fine. It was showing > > some compaction information every few seconds. > > > > JM > > > > 2013/1/1, Ted <[email protected]>: > > > You're on hbase 0.94.3 , right ? > > > > > > When was the last time major compaction ran ? > > > > > > Compaction is region server activity so you should be able to find some > > clue > > > in region server log. > > > > > > Cheers > > > > > > On Jan 1, 2013, at 11:42 AM, Jean-Marc Spaggiari < > > [email protected]> > > > wrote: > > > > > >> Hi, > > >> > > >> I have a table, with about 200 000 raws, keys is string[64] (ish) and > > >> value is string[512]. > > >> > > >> It's splitted over 16 regions located on 7 regionservers. > > >> > > >> So it's not a big table, and there is a lot of horsepower behind it. > > >> > > >> I asked a major_compaction few hours ago. Let's say, about 5 hours > > >> ago. and it's still compacting! But all servers activities seems to be > > >> null. CPU usage is almost 0. > > >> > > >> There is nothing on the master logs. > > >> > > >> How can I see what's going on? Is there a way to see the compaction > > >> queue? > > >> > > >> JM > > > > > > -- Adrien Mogenet 06.59.16.64.22 http://www.mogenet.me
