Solved the problem. I recopied hbase-site.xml file from master server to region servers which contained 'hbase.replication' property, restarted both the clusters and replication started working. Looks like updated file didn't get copied into region servers.
Thanks a lot for your pointers.. Regards, Chandrash3khar Kotekar Mobile - +91 8600011455 On Tue, Apr 28, 2015 at 5:11 PM, Dejan Menges <dejan.men...@gmail.com> wrote: > Maybe you missed some steps - I did it bunch of times following these steps > here: > > http://hbase.apache.org/book.html#_cluster_replication > > On Tue, Apr 28, 2015 at 1:39 PM Chandrashekhar Kotekar < > shekhar.kote...@gmail.com> wrote: > > > Yes. When replication did not worked then I copied 4 rows which were > > already present in primary cluster using copyTables program. Those 4 rows > > properly got copied into target cluster. > > > > > > Regards, > > Chandrash3khar Kotekar > > Mobile - +91 8600011455 > > > > On Tue, Apr 28, 2015 at 4:48 PM, Dejan Menges <dejan.men...@gmail.com> > > wrote: > > > > > Hi, > > > > > > Did you copy the table that you want to replicate first to destination > > > cluster? > > > > > > Thanks, > > > Dejan > > > > > > On Tue, Apr 28, 2015 at 1:06 PM Chandrashekhar Kotekar < > > > shekhar.kote...@gmail.com> wrote: > > > > > > > Hi, > > > > > > > > I have setup cluster replication between 2 clusters but data is not > > > getting > > > > copied. Can anyone please help me in cluster replication? > > > > > > > > I would like to know if I add only 1 row in one of the tables then > will > > > > that row get replicated in other cluster or HBase waits for some time > > or > > > > HBase waits before certain amount of data is added/deleted/edited > (like > > > > 64MB)? > > > > > > > > Clusters are based on CDH 5.3.1 which have 0.98.6 version of HBase. I > > > have > > > > named slave nodes of both the clusters as slave1 and slave2 and > master > > > > server is named as hbase-master (This setting is in /etc/hosts file). > > > > > > > > I took following steps to setup replication: > > > > 1) Set value of 'hbase.replication' property in 'hbase-site.xml' file > > to > > > > true in both the clusters > > > > > > > > 2) Restarted HBase master and all region servers of both the > clusters. > > > > (Restarting needs to be done in any specifi order?? like master first > > > then > > > > region server or vice versa??) > > > > > > > > 3) Disabled, Altered all the tables in both the clusters by adding > > "{NAME > > > > => 'CF', REPLICATION_SCOPE => 1}" in alter statement, and then > enabled > > > > tables one by one. (CF is actual column family name) > > > > > > > > 4) Added peer using "add_peer '1', '10.0.21.249:2181:/hbase' " in > > > primary > > > > cluster. > > > > > > > > 5) added peer using "add_peer 'nc' '10.0.21.111:/hbase '" in target > > > > cluster. > > > > > > > > 6) Primary cluster already has 4 rows. Added one more row having one > > > column > > > > for COMPANY_TABLE into primary cluster. So expecting either total 5 > > rows > > > in > > > > target cluster or at least newly added row in target cluster. Waited > > few > > > > minutes for row to get replicated into other cluster. Executed scan > > > > 'table_name' command in target cluster but didnt get that row from > > > primary > > > > cluster. > > > > > > > > 7) Executed following verify replication command in primary cluster. > > This > > > > command runs m-r job and shows 4 good rows but in target cluster no > row > > > > present for COMPANY_TABLE table. > > > > > > > > hbase org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication > > > > --families=CF nc COMPANY_TABLE > > > > > > > > > > > > There's no error in region server logs. Sample logs from primary > > > cluster's > > > > region server is as as below: > > > > > > > > 15/04/28 10:48:16 INFO regionserver.HRegionServer: Adding moved > region > > > > record: 1a685b27708dfea86bb2d8a9ca1bceb5 to > > > > ip-10-0-21-90.ec2.internal,60020,1430217861644:60020 as of 4873480 > > > > 15/04/28 10:51:06 INFO regionserver.Replication: Normal source for > > > cluster > > > > nc: Total replicated edits: 0, currently replicating from: > > > > > > > > > > > > > > hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727 > > > > at position: 83 > > > > > > > > 15/04/28 10:56:06 INFO regionserver.Replication: Normal source for > > > cluster > > > > nc: Total replicated edits: 0, currently replicating from: > > > > > > > > > > > > > > hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727 > > > > at position: 83 > > > > > > > > 15/04/28 11:01:06 INFO regionserver.Replication: Normal source for > > > cluster > > > > nc: Total replicated edits: 0, currently replicating from: > > > > > > > > > > > > > > hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727 > > > > at position: 83 > > > > > > > > Regards, > > > > Chandrash3khar Kotekar > > > > Mobile - +91 8600011455 > > > > > > > > > >
