These days I think the recommendation is more like 20 regions per region server, and the region size set accordingly. The major caveat is that when you start compacting the bigger store files you can really take a massive IO hit, so most of the time major compactions are tuned to run only every week or disabled and ran manually during low traffic. The FB peeps did a lot of experimenting and that's what they are currently running, they also contributed back a few optimizations for compactions in 0.92. In our case we have a pretty old setup and had way too many regions so we ran a few online merges to bring this down to like 80 regions/RS and it's working pretty well.
J-D On Tue, Nov 1, 2011 at 10:54 AM, Sujee Maniyam <[email protected]> wrote: > HI all, > My HBase cluster is 10 nodes, each node has 12core , 48G RAM, 24TB disk, > 10GEthernet. > My region size is 1GB. > > Any guidelines on how many regions can a RS handle comfortably? > I vaguely remember reading some where to have no more than 1000 regions / > server; that comes to 1TB / server. Seems pretty low for the current > hardware config. > > Any rules of thumb? experiences? > > thanks > Sujee > > http://sujee.net >
