Thanks for the valuable reply. I'll follow the tips and let you know. Regards, Mohammad Tariq
On Tue, Dec 20, 2011 at 7:21 PM, Andrei Savu <[email protected]> wrote: > Here are some quick ideas. I will investigate more later if you still have > problems. > > 1. make sure you are referencing the right config files for Hive from HBase > 2. we are not using the HBase embedded ZooKeeper server - we are running a > standalone > instance by default (you should see a zookeeper role in your > whirr.instance-templates) > 3. to be able to browse the filesystem you need to start the SOCKS proxy and > setup > Firefox to use that when connecting to AWS hosts. > > -- Andrei Savu / andreisavu.ro > > On Tue, Dec 20, 2011 at 2:48 PM, Mohammad Tariq <[email protected]> wrote: >> >> Not really.Everything is working fine in isolation.But when I am >> trying to integrate Hbase and Hive, I am facing some problem.Whenever >> I am trying to create an external table using Hive for an existing >> Hbase table, I am getting the following error - >> >> hive> create external table demo(key string,name string,addr string) >> > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' >> > WITH SERDEPROPERTIES ("hbase.columns.mapping" = >> ":key,cf1:name,cf2:addr") >> > TBLPROPERTIES("hbase.table.name"= "demo"); >> FAILED: Error in metadata: >> >> MetaException(message:org.apache.hadoop.hbase.ZooKeeperConnectionException: >> org.apache.hadoop.hbase.ZooKeeperConnectionException: >> org.apache.zookeeper.KeeperException$ConnectionLossException: >> KeeperErrorCode = ConnectionLoss for /hbase >> at >> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:985) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292) >> at >> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155) >> at >> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:79) >> at >> org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:74) >> at >> org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:158) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344) >> at >> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470) >> at >> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146) >> at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213) >> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130) >> at >> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) >> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063) >> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900) >> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748) >> at >> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164) >> at >> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241) >> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> at java.lang.reflect.Method.invoke(Method.java:597) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:156) >> Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: >> org.apache.zookeeper.KeeperException$ConnectionLossException: >> KeeperErrorCode = ConnectionLoss for /hbase >> at >> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:147) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:983) >> ... 23 more >> Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: >> KeeperErrorCode = ConnectionLoss for /hbase >> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:90) >> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:42) >> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:637) >> at >> org.apache.hadoop.hbase.zookeeper.ZKUtil.createAndFailSilent(ZKUtil.java:886) >> at >> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:133) >> ... 24 more >> ) >> >> Do I need to download and configure zookeeper separately?? >> Also I am not able able to browse the filesystem through its web >> interface.I can just see the namenode interface, and as soon as I >> click on "Browse the filesystem", the page goes not responding. >> >> Regards, >> Mohammad Tariq >> >> >> >> On Tue, Dec 20, 2011 at 5:27 PM, Andrei Savu <[email protected]> >> wrote: >> > It should be fine as long as you match the HBase version (and you trust >> > them). >> > >> > Are things working for you now with this change in place? >> > >> > -- Andrei Savu >> > >> > On Tue, Dec 20, 2011 at 1:42 PM, Mohammad Tariq <[email protected]> >> > wrote: >> >> >> >> Hi Andrei, >> >> >> >> I am using Apache's distribution.Thanks for the link.I have >> >> downloaded the jar from the following >> >> >> >> >> >> link-"http://www.java2s.com/Code/Jar/h/Downloadhbase08920100924testsjar.htm"..Is >> >> it ok??or do I need to go to Maven central?? >> >> >> >> Regards, >> >> Mohammad Tariq >> >> >> >> >> >> >> >> On Tue, Dec 20, 2011 at 3:44 PM, Andrei Savu <[email protected]> >> >> wrote: >> >> > First of all are you deploying CDH or the Apache HBase release? >> >> > >> >> > I can confirm that the following tarball does not ship with the tests >> >> > jar. >> >> > >> >> > >> >> > http://archive.apache.org/dist/hbase/hbase-0.89.20100924/hbase-0.89.20100924-bin.tar.gz >> >> > >> >> > Have you considered fetching it from Maven Central? >> >> > >> >> > See the "tests.jar" on the following page: >> >> > >> >> > >> >> > http://search.maven.org/#search%7Cgav%7C1%7Cg%3A%22org.apache.hbase%22%20AND%20a%3A%22hbase%22 >> >> > >> >> > -- Andrei Savu / andreisavu.ro >> >> > >> >> > >> >> > On Tue, Dec 20, 2011 at 10:00 AM, Mohammad Tariq <[email protected]> >> >> > wrote: >> >> >> >> >> >> Hello list, >> >> >> I have a cluster that has Hadoop and Hbase running on it. Now I am >> >> >> trying to integrate Hbase and Hive together, and for that I need to >> >> >> put the hbase-*-test.jar in hive/lib folder but the hbase-*-test.jar >> >> >> is not present in Hbase.Has anyone tried it??Hive alone is working >> >> >> fine..Need some help. >> >> >> >> >> >> Regards, >> >> >> Mohammad Tariq >> >> > >> >> > >> > >> > > >
