Re: regions stuck in transition

2015-09-07 Thread Hbase Janitor
I'm checking now, but I think there was some kind of network problem during the time. I was also asking for future reference =-) On Mon, Sep 7, 2015 at 4:42 PM, Ted Yu wrote: > For the region with corrupt hfile, regardless how many times it is > attempted to be opened,

Re: regions stuck in transition

2015-09-07 Thread Hbase Janitor
Is there any way to make region in transition try again if the initial try failed? On Mon, Sep 7, 2015 at 3:22 PM, Hbase Janitor wrote: > looks like I have a corrupt hfile, probably related to the replication > problems i'm having now. > > Thanks for the help! > > On

Re: regions stuck in transition

2015-09-07 Thread Ted Yu
For the region with corrupt hfile, regardless how many times it is attempted to be opened, failure to open would result, right ? > On Sep 7, 2015, at 1:36 PM, Hbase Janitor wrote: > > Is there any way to make region in transition try again if the initial try > failed?

Re: regions stuck in transition

2015-09-07 Thread Ted Yu
After timeout, the master would re-assign those regions. Can you check region server log to see why region open failed ? Was there any HFile which couldn't be opened ? Pastebinning log snippet if needed. Cheers On Mon, Sep 7, 2015 at 11:24 AM, Hbase Janitor wrote: >

regions stuck in transition

2015-09-07 Thread Hbase Janitor
Hi, I have another problem, on my hbase 1.0 cluster I have a lot of regions that seem to be stuck in transition. I saw a exception attempting to connect to zookeeper around the time they were hung. Is there a way to force them to retry?

Re: regions stuck in transition

2015-09-07 Thread Hbase Janitor
looks like I have a corrupt hfile, probably related to the replication problems i'm having now. Thanks for the help! On Mon, Sep 7, 2015 at 3:16 PM, Ted Yu wrote: > After timeout, the master would re-assign those regions. > > Can you check region server log to see why

Re: regions stuck in transition

2012-04-18 Thread Bryan Beaudreault
Yes, I can get data from the region through the shell. The problem is the balancer cannot run when a region is in transition, so it is never running. Our region servers are becoming increasingly unbalanced. I don't want to restart a RegionServer, because it would cause a blip in requests for

Re: regions stuck in transition

2012-04-18 Thread Stack
On Mon, Apr 16, 2012 at 8:21 AM, Bryan Beaudreault bbeaudrea...@hubspot.com wrote: We've recently had a problem where regions will get stuck in transition for a long period of time.  In fact, they don't ever appear to get out-of-transition unless we take manual action.  Last time this happened

Re: regions stuck in transition

2012-04-18 Thread Stack
On Wed, Apr 18, 2012 at 7:38 AM, Bryan Beaudreault bbeaudrea...@hubspot.com wrote: Yes, I can get data from the region through the shell.  The problem is the balancer cannot run when a region is in transition, so it is never running.  Our region servers are becoming increasingly unbalanced.

Re: regions stuck in transition

2012-04-17 Thread Alex Baranau
I've seen similar behavior at our cluster too. From the top of my head, you can try to restart particular RegionServer, where those regions belong too (in cases I saw usually single regionserver was an issue). Have you tried to access data from that region (e.g. in shell)? I think it should

regions stuck in transition

2012-04-16 Thread Bryan Beaudreault
Hello, We've recently had a problem where regions will get stuck in transition for a long period of time. In fact, they don't ever appear to get out-of-transition unless we take manual action. Last time this happened I restarted the master and they were cleared out. This time I wanted to