Yes. When replication did not worked then I copied 4 rows which were already present in primary cluster using copyTables program. Those 4 rows properly got copied into target cluster.
Regards, Chandrash3khar Kotekar Mobile - +91 8600011455 On Tue, Apr 28, 2015 at 4:48 PM, Dejan Menges <[email protected]> wrote: > Hi, > > Did you copy the table that you want to replicate first to destination > cluster? > > Thanks, > Dejan > > On Tue, Apr 28, 2015 at 1:06 PM Chandrashekhar Kotekar < > [email protected]> wrote: > > > Hi, > > > > I have setup cluster replication between 2 clusters but data is not > getting > > copied. Can anyone please help me in cluster replication? > > > > I would like to know if I add only 1 row in one of the tables then will > > that row get replicated in other cluster or HBase waits for some time or > > HBase waits before certain amount of data is added/deleted/edited (like > > 64MB)? > > > > Clusters are based on CDH 5.3.1 which have 0.98.6 version of HBase. I > have > > named slave nodes of both the clusters as slave1 and slave2 and master > > server is named as hbase-master (This setting is in /etc/hosts file). > > > > I took following steps to setup replication: > > 1) Set value of 'hbase.replication' property in 'hbase-site.xml' file to > > true in both the clusters > > > > 2) Restarted HBase master and all region servers of both the clusters. > > (Restarting needs to be done in any specifi order?? like master first > then > > region server or vice versa??) > > > > 3) Disabled, Altered all the tables in both the clusters by adding "{NAME > > => 'CF', REPLICATION_SCOPE => 1}" in alter statement, and then enabled > > tables one by one. (CF is actual column family name) > > > > 4) Added peer using "add_peer '1', '10.0.21.249:2181:/hbase' " in > primary > > cluster. > > > > 5) added peer using "add_peer 'nc' '10.0.21.111:/hbase '" in target > > cluster. > > > > 6) Primary cluster already has 4 rows. Added one more row having one > column > > for COMPANY_TABLE into primary cluster. So expecting either total 5 rows > in > > target cluster or at least newly added row in target cluster. Waited few > > minutes for row to get replicated into other cluster. Executed scan > > 'table_name' command in target cluster but didnt get that row from > primary > > cluster. > > > > 7) Executed following verify replication command in primary cluster. This > > command runs m-r job and shows 4 good rows but in target cluster no row > > present for COMPANY_TABLE table. > > > > hbase org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication > > --families=CF nc COMPANY_TABLE > > > > > > There's no error in region server logs. Sample logs from primary > cluster's > > region server is as as below: > > > > 15/04/28 10:48:16 INFO regionserver.HRegionServer: Adding moved region > > record: 1a685b27708dfea86bb2d8a9ca1bceb5 to > > ip-10-0-21-90.ec2.internal,60020,1430217861644:60020 as of 4873480 > > 15/04/28 10:51:06 INFO regionserver.Replication: Normal source for > cluster > > nc: Total replicated edits: 0, currently replicating from: > > > > > hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727 > > at position: 83 > > > > 15/04/28 10:56:06 INFO regionserver.Replication: Normal source for > cluster > > nc: Total replicated edits: 0, currently replicating from: > > > > > hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727 > > at position: 83 > > > > 15/04/28 11:01:06 INFO regionserver.Replication: Normal source for > cluster > > nc: Total replicated edits: 0, currently replicating from: > > > > > hdfs://StagingCluster/hbase/WALs/slave2,60020,1430201462672/slave2%2C60020%2C1430201462672.1430215999727 > > at position: 83 > > > > Regards, > > Chandrash3khar Kotekar > > Mobile - +91 8600011455 > > >
