Hi, Did you copy the table that you want to replicate first to destination cluster?
Thanks, Dejan On Tue, Apr 28, 2015 at 1:06 PM Chandrashekhar Kotekar < [email protected]> wrote: > Hi, > > I have setup cluster replication between 2 clusters but data is not getting > copied. Can anyone please help me in cluster replication? > > I would like to know if I add only 1 row in one of the tables then will > that row get replicated in other cluster or HBase waits for some time or > HBase waits before certain amount of data is added/deleted/edited (like > 64MB)? > > Clusters are based on CDH 5.3.1 which have 0.98.6 version of HBase. I have > named slave nodes of both the clusters as slave1 and slave2 and master > server is named as hbase-master (This setting is in /etc/hosts file). > > I took following steps to setup replication: > 1) Set value of 'hbase.replication' property in 'hbase-site.xml' file to > true in both the clusters > > 2) Restarted HBase master and all region servers of both the clusters. > (Restarting needs to be done in any specifi order?? like master first then > region server or vice versa??) > > 3) Disabled, Altered all the tables in both the clusters by adding "{NAME > => 'CF', REPLICATION_SCOPE => 1}" in alter statement, and then enabled > tables one by one. (CF is actual column family name) > > 4) Added peer using "add_peer '1', '10.0.21.249:2181:/hbase' " in primary > cluster. > > 5) added peer using "add_peer 'nc' '10.0.21.111:/hbase '" in target > cluster. > > 6) Primary cluster already has 4 rows. Added one more row having one column > for COMPANY_TABLE into primary cluster. So expecting either total 5 rows in > target cluster or at least newly added row in target cluster. Waited few > minutes for row to get replicated into other cluster. Executed scan > 'table_name' command in target cluster but didnt get that row from primary > cluster. > > 7) Executed following verify replication command in primary cluster. This > command runs m-r job and shows 4 good rows but in target cluster no row > present for COMPANY_TABLE table. > > hbase org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication > --families=CF nc COMPANY_TABLE > > > There's no error in region server logs. Sample logs from primary cluster's > region server is as as below: > > 15/04/28 10:48:16 INFO regionserver.HRegionServer: Adding moved region > record: 1a685b27708dfea86bb2d8a9ca1bceb5 to > ip-10-0-21-90.ec2.internal,60020,1430217861644:60020 as of 4873480 > 15/04/28 10:51:06 INFO regionserver.Replication: Normal source for cluster > nc: Total replicated edits: 0, currently replicating from: > > hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727 > at position: 83 > > 15/04/28 10:56:06 INFO regionserver.Replication: Normal source for cluster > nc: Total replicated edits: 0, currently replicating from: > > hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727 > at position: 83 > > 15/04/28 11:01:06 INFO regionserver.Replication: Normal source for cluster > nc: Total replicated edits: 0, currently replicating from: > > hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727 > at position: 83 > > Regards, > Chandrash3khar Kotekar > Mobile - +91 8600011455 >
