Hi all, 1- I couldn't get TestHBaseStorage unit test running with hadoop-1.2.1 and hbase-0.94.12. Is it supposed to work with those versions? The test hangs for some time and fails with the exception below.
2- Is there any Pig function for deleting rows from an existing HBase table? With some research I couldn't find one and I am implementing a store function for that purpose. If anyone is interested I will be happy to contribute it. The delete functionality can also be imitated with the existing HBaseStorage function by storing the filtered tuples to a new HBase table, but this has quite some overhead for large datasets. Thanks, Nezih [junit] java.io.IOException: Shutting down [junit] at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:203) [junit] at org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:76) [junit] at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:632) [junit] at org.apache.pig.test.TestHBaseStorage.setUp(TestHBaseStorage.java:86) [junit] Caused by: java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterKeeperErrorCode = ConnectionLoss for /hbase [junit] at org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:134) [junit] at org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:197) [junit] at org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:147) [junit] at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:185) [junit] Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: master:57543-0x143b26706a80000-0x143b26706a80000-0x143b26706a80000-0x143b26706a80000 Unexpected KeeperException creating base node [junit] at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:169) [junit] at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:154) [junit] at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:282) [junit] at java.lang.reflect.Constructor.newInstance(Constructor.java:525) [junit] at org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:131) [junit] Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase [junit] at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) [junit] at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1036) [junit] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1064) [junit] at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:176) [junit] at org.apache.hadoop.hbase.zookeeper.ZKUtil.createAndFailSilent(ZKUtil.java:903) [junit] at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:161) [junit] [junit] Test org.apache.pig.test.TestHBaseStorage FAILED