Hi Randy, As Ted suggested a couple of stack traces would be helpful but if you could attach the HMaster and a couple of RS logs where you see this problem that would be great. Also, do you have a large regions that might need some time to flush? have you looked into any potential problem in HDFS?
thanks, esteban. -- Cloudera, Inc. On Thu, Oct 15, 2015 at 10:39 AM, Ted Yu <[email protected]> wrote: > Can you give a bit more detail on why block eviction was cause for the > slow region movement? > > Did you happen to take stack traces ? > > Thanks > > > On Oct 15, 2015, at 10:32 AM, Randy Fox <[email protected]> wrote: > > > > Hi, > > > > We just upgraded from 0.94 to 1.0.0 and have noticed that region moves > are super slow (order of minutes) whereas previously they where in the > seconds range. After looking at the code, I think the time is spent > waiting for the blocks to be evicted from block cache. > > > > I wanted to verify that this theory is correct and see if there is > anything that can be done to speed up the moves. > > > > This is particular painful as we are trying to get our configs tuned to > the new SW and need to do rolling restarts which is taking almost 24 hours > on our cluster. We also do our own manual rebalancing of regions across > RS’s and that task is also now painful. > > > > > > Thanks, > > > > Randy >
