Hi Dima,
As suggest by you not run HDFS Blancer untill I run Major compaction. so till now what i did I added one node with same configuration as other node are. I did not run HDFS blancer due to this I am getting error on cloudera. I have performed Major compation now still I am getting error on cloudera that HDFS blancer is not enabled. question is do I need to run HDFS blancer now? also please let me know if possible what is the recommanded streps to add new node in cluster. do I need to take down time and stop Hbase and then perform these task? second can we not add node if cases 1 is true (means need to stop hbase). Thanks Manjeet On Fri, Oct 7, 2016 at 6:33 PM, Dima Spivak <[email protected]> wrote: > Yeah, just to reinforce what Ted is saying, DO NOT run HDFS's balancer if > you use HBase. Doing so will move blocks in such a way as to destroy data > locality and negatively impact HBase performance (until a major compaction > in HBase is done). > > On Friday, October 7, 2016, Ted Yu <[email protected]> wrote: > > > For #1, it depends on whether major compaction is disabled. If major > > compaction is enabled, timing of major compaction would affect the data > > locality. > > > > For #2, no. hdfs rebalance is orthogonal to hbase. > > > > For #3, perform major compaction at earliest convenience. > > > > On Thu, Oct 6, 2016 at 11:47 PM, Manjeet Singh < > [email protected] > > <javascript:;>> > > wrote: > > > > > Hi All, > > > I have question on re balance, my query is how hbase rebalancing the > data > > > after adding new nodes in cluster > > > <http://stackoverflow.com/questions/23686387/hadoop-and- > > > hbase-rebalancing-after-node-additions> > > > ? > > > > > > > > > > > > 1. Do I need to explicitly rebalance hbase after adding the new node > > in > > > cluster? > > > > > > 2. On my cloudera I have hdfs rebalance does its take care of hbase > > data > > > to be balance? > > > > > > 3. What is the best way to make sure that both hadoop and hbase are > > > rebalanced and work fine? > > > > > > > > > Thanks > > > > > > Manjeet > > > > > > -- > > > luv all > > > > > > > > -- > -Dima > -- luv all
