Thank you for making this contribution Jia Liu. St.Ack
On Wed, Jul 27, 2011 at 3:55 AM, Liujia <[email protected]> wrote: > Now The Isolation and allocation part of HBase is available. > The issue is discussed in > https://issues.apache.org/jira/browse/HBASE-4120,the source code and patched > tarball are located in https://github.com/ICT-Ope/HBase_allocation, Two > versions Integrated with HBase 0.90.2 and 0.90.3 are available to use. > The HBase isolation and allocation tool is designed to help users manage > cluster resource among different applications and tables.When we have a large > scale of HBase cluster with many applications running on it, there will be > lots of problems. In Taobao.Inc there is a cluster for many departments to > test their applications' performance, these applications are based on HBase. > With one cluster which > has 12 servers, there will be only one application running exclusively on > this server, many other applications must wait until the previous test > finished.After we add allocation management function to the cluster, > applications can share the cluster and run concurrently. Also if the Test > Engineers want to make > sure that there is no interference, they can move other tables out of this > group. > Different groups can have different region server configurations, which means > that some groups optimized for reading can have large block cache size, and > others optimized for writing can have large memstore size. Tables and region > servers can be moved easily between groups. After changing the configuration, > a group can be restarted alone instead of restarting the > whole cluster. > In groups we use table priority to allocate resource. When system is busy, > this can make sure high-priority tables not affected by lower-priority ones > Though we put group and priority of tables together, users can use them > separately, there is no inseparable link between these two functions. > Suggestions and advice are welcome, please send mails to me or post your > opinions on JIRA. > Jia Liu > Key Laboratory of Network Science and Technology, > Institute of Computing Technology, > Chinese Academy of Sciences, > P.O.Box 2704, Beijing 100190, China. > >
