Hi Buttler, Issue is resolved
-----Original Message----- From: Stuti Awasthi Sent: Thursday, September 15, 2011 3:19 PM To: [email protected] Subject: RE: Hbase copytable and export/import Hi Butlerh , I have modified my cluster settings. Now I specified each machines IP and hostname in etc/hosts file. Hbase-conf-site.xml <name>hbase.rootdir</name> <value>hdfs://master2:54310/hbase</value> </property> Here master2 is hostname given for backup cluster IP but still facing same issue. Please suggest Thanks -----Original Message----- From: Buttler, David [mailto:[email protected]] Sent: Thursday, September 01, 2011 12:22 AM To: [email protected] Subject: RE: Hbase copytable and export/import If you are doing distributed clusters (even pseudo-distributed), I don't think you should be using localhost as the address. Especially if you want to communicate between two different clusters -----Original Message----- From: Stuti Awasthi [mailto:[email protected]] Sent: Tuesday, August 30, 2011 9:21 PM To: [email protected] Subject: RE: Hbase copytable and export/import Hi Jean, I will try to explain more clearly. I have 2 cluster each single node Hadoop and Hbase cluster. I can create tables and perform other operation of Hbase in both the cluster individually. Now I wanted to copy a table from 1 cluster (say A) to other cluster (say B). In both the cluster, hbase-site.xml looks like this : <configuration> <property> <name>hbase.rootdir</name> <value>hdfs://localhost:54310/hbase</value> </property> <property> <name>dfs.replication</name> <value>1</value> <description>The replication count for HLog and HFile storage. Should not be greater than HDFS datanode count. </description> </property> </configuration> Thanks -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Jean-Daniel Cryans Sent: Tuesday, August 30, 2011 10:33 PM To: [email protected] Subject: Re: Hbase copytable and export/import Your remote cluster reports the location of -ROOT- as on localhost on port 41181: 11/08/30 19:27:47 DEBUG client.HConnectionManager$HConnectionImplementation: Lookedup root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@10d593e<connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@10d593e%3cconnection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@10d593e>>; hsa=localhost:41181 (hsa is the name of the class in HBase, HServerAddress) Is that "cluster" really just a standalone instance or something like that? That's usually what happens. J-D On Tue, Aug 30, 2011 at 9:27 AM, Stuti Awasthi <[email protected]<mailto:[email protected]>> wrote: > Hi , > > I tried debugging this and got to know that in my master hbase cluster 41181 > port is not opened. I tried telnet to this port but connection refused. > Following are the steps did : > > Start Hadoop > Start Hbase > Created a table via hbase shell > List the contents of table via hbase shell Tried Copytable command. > > Am I missing something ? > > From: Stuti Awasthi > Sent: Tuesday, August 30, 2011 7:57 PM > To: '[email protected]' > Subject: RE: Hbase copytable and export/import > > Hi Friends, > > I referred http://hbase.apache.org/book.html#copytable and I am successful > in copying my table within same cluster. I am then trying to copy m table to > other Hadoop-Hbase cluster but facing issues in that . > I used following command format : > > ./hbase org.apache.hadoop.hbase.mapreduce.CopyTable > --new.name=<NewTableName> --peer.adr=<different cluster > IP>:2181:/hbase <Tablename> > > But facing issues. Do we also need to do some entry in hdfs-site.xml to do it > correctly. Also is there any reqirement of password less ssh in this ? > > Console logs are like this : > > 11/08/30 19:27:41 INFO zookeeper.ZooKeeper: Initiating client > connection, connectString=10.33.100.117:2181 sessionTimeout=180000 > watcher=hconnection > 11/08/30 19:27:41 INFO zookeeper.ClientCnxn: Opening socket connection > to server /10.33.100.117:2181 > 11/08/30 19:27:47 INFO zookeeper.ClientCnxn: Socket connection > established to 10.33.100.117/10.33.100.117:2181, initiating session > 11/08/30 19:27:47 INFO zookeeper.ClientCnxn: Session establishment > complete on server 10.33.100.117/10.33.100.117:2181, sessionid = > 0x1321ad9bb980007, negotiated timeout = 40000 > 11/08/30 19:27:47 DEBUG > client.HConnectionManager$HConnectionImplementation: Lookedup root > region location, > connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti > onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli> > ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>; > hsa=localhost:41181 > 11/08/30 19:27:47 INFO ipc.HbaseRPC: Server at localhost/127.0.0.1:41181 > could not be reached after 1 tries, giving up. > 11/08/30 19:27:47 DEBUG > client.HConnectionManager$HConnectionImplementation: > locateRegionInMeta parentTable=-ROOT-, metaLocation=address: > localhost:41181, regioninfo: -ROOT-,,0.70236052, attempt=0 of 10 > failed; retrying after sleep of 1000 because: Failed setting up proxy > interface org.apache.hadoop.hbase.ipc.HRegionInterface to > localhost/127.0.0.1:41181 after attempts=1 > 11/08/30 19:27:47 DEBUG > client.HConnectionManager$HConnectionImplementation: Lookedup root > region location, > connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti > onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli> > ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>; > hsa=localhost:41181 > 11/08/30 19:27:48 DEBUG > client.HConnectionManager$HConnectionImplementation: Lookedup root > region location, > connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti > onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli> > ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>; > hsa=localhost:41181 > 11/08/30 19:27:48 INFO ipc.HbaseRPC: Server at localhost/127.0.0.1:41181 > could not be reached after 1 tries, giving up. > 11/08/30 19:27:48 DEBUG > client.HConnectionManager$HConnectionImplementation: > locateRegionInMeta parentTable=-ROOT-, metaLocation=address: > localhost:41181, regioninfo: -ROOT-,,0.70236052, attempt=1 of 10 > failed; retrying after sleep of 1000 because: Failed setting up proxy > interface org.apache.hadoop.hbase.ipc.HRegionInterface to > localhost/127.0.0.1:41181 after attempts=1 > 11/08/30 19:27:48 DEBUG > client.HConnectionManager$HConnectionImplementation: Lookedup root > region location, > connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti > onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli> > ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>; > hsa=localhost:41181 > 11/08/30 19:27:49 DEBUG > client.HConnectionManager$HConnectionImplementation: Lookedup root > region location, > connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnecti > onImplementation@10d593e<mailto:connection=org.apache.hadoop.hbase.cli<mailto:onImplementation@10d593e%3cmailto:connection=org.apache.hadoop.hbase.cli> > ent.HConnectionManager$HConnectionImplementation@10d593e<mailto:ent.HConnectionManager$HConnectionImplementation@10d593e>>; > hsa=localhost:41181 > 11/08/30 19:27:49 INFO ipc.HbaseRPC: Server at localhost/127.0.0.1:41181 > could not be reached after 1 tries, giving up. > 11/08/30 19:27:49 DEBUG > client.HConnectionManager$HConnectionImplementation: > locateRegionInMeta parentTable=-ROOT-, metaLocation=address: > localhost:41181, regioninfo: -R > > Please suggest > > Stuti > > From: Stuti Awasthi > Sent: Tuesday, August 30, 2011 2:52 PM > To: '[email protected]' > Subject: Hbase copytable and export/import > > Hi , > > I want to try copy table and export/import utility of Hbase for data > backup. I am using Hadoop 0.20.2 and Hbase 0.90.3 I was trying to apply the > patch given at https://issues.apache.org/jira/browse/HBASE-2221 , but this is > giving me error. Is this patch is not for Hbase-0.90.3. > > Please guide me to get correct patches > > Thanks & Regards > Stuti Awasthi > > ________________________________ > ::DISCLAIMER:: > ---------------------------------------------------------------------- > ------------------------------------------------- > > The contents of this e-mail and any attachment(s) are confidential and > intended for the named recipient(s) only. > It shall not attach any liability on the originator or HCL or its > affiliates. Any views or opinions presented in this email are solely those of > the author and may not necessarily reflect the opinions of HCL or its > affiliates. > Any form of reproduction, dissemination, copying, disclosure, > modification, distribution and / or publication of this message > without the prior written consent of the author of this e-mail is > strictly prohibited. If you have received this email in error please delete > it and notify the sender immediately. Before opening any mail and attachments > please check them for viruses and defect. > > ---------------------------------------------------------------------- > ------------------------------------------------- >
