Dmitriy, see https://issues.apache.org/jira/browse/PIG-1680 and let me know what you think. I don't think the current trunk can really work against hbase 0.89 using an HBaseStorage compiled against the hbase 0.20.6 API. Locally at least, a 0.20.6 client cannot connect to a 0.89 instance for me. We had the same issue in our application's DAOs and we had to re-compile them against the 0.89 API.
Once I did that with the patch attached to PIG-1680, my pig scripts started working again. -GS On Wed, Oct 13, 2010 at 10:29 PM, George P. Stathis <[email protected]>wrote: > Update: wait for it long enough and this is the resulting stack trace: > > 2010-10-13 22:01:54,791 [Thread-4] INFO org.apache.zookeeper.ZooKeeper - > Initiating client connection, host=localhost:2181 sessionTimeout=60000 > watcher=org.apache.hadoop.hbase.client.hconnectionmanager$clientzkwatc...@14cb754f > 2010-10-13 22:01:54,792 [Thread-4] INFO org.apache.zookeeper.ClientCnxn - > zookeeper.disableAutoWatchReset is false > 2010-10-13 22:01:54,820 [Thread-4-SendThread] INFO > org.apache.zookeeper.ClientCnxn - Attempting connection to server > localhost/fe80:0:0:0:0:0:0:1%1:2181 > 2010-10-13 22:01:54,832 [Thread-4-SendThread] INFO > org.apache.zookeeper.ClientCnxn - Priming connection to > java.nio.channels.SocketChannel[connected local=/fe80:0:0:0:0:0:0:1%1:57908 > remote=localhost/fe80:0:0:0:0:0:0:1%1:2181] > 2010-10-13 22:01:54,850 [Thread-4-SendThread] INFO > org.apache.zookeeper.ClientCnxn - Server connection successful > 2010-10-13 22:01:54,952 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - 0% complete > 2010-10-13 22:25:45,646 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - job null has failed! Stop running all dependent jobs > 2010-10-13 22:25:45,714 [main] WARN org.apache.pig.tools.pigstats.JobStats > - unable to get input counter for influencers > 2010-10-13 22:25:45,718 [main] WARN org.apache.pig.tools.pigstats.JobStats > - unable to get input counter for channels > 2010-10-13 22:25:45,719 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - 100% complete > 2010-10-13 22:25:45,795 [main] ERROR org.apache.pig.tools.pigstats.PigStats > - ERROR 2118: Timed out trying to locate root region > 2010-10-13 22:25:45,795 [main] ERROR > org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed! > 2010-10-13 22:25:45,795 [main] INFO org.apache.pig.tools.pigstats.PigStats > - Detected Local mode. Stats reported below may be incomplete > 2010-10-13 22:25:45,797 [main] INFO org.apache.pig.tools.pigstats.PigStats > - Script Statistics: > > HadoopVersion PigVersion UserId StartedAt FinishedAt Features > 0.20.2 0.8.0-SNAPSHOT gstathis 2010-10-13 22:01:52 2010-10-13 22:25:45 > HASH_JOIN,FILTER > > Failed! > > Failed Jobs: > JobId Alias Feature Message Outputs > N/A allinfs,allinfs_strings,channels,infs,infsAndChannels,suspects > HASH_JOIN Message: org.apache.pig.backend.executionengine.ExecException: > ERROR 2118: Timed out trying to locate root region > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:280) > at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885) > at > org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779) > at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730) > at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378) > at > org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247) > at > org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279) > at java.lang.Thread.run(Thread.java:637) > Caused by: org.apache.hadoop.hbase.client.NoServerForRegionException: Timed > out trying to locate root region > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:983) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:625) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:601) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:670) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:630) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:601) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:670) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:634) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:601) > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:134) > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:112) > at > org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:289) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:261) > ... 7 more > > > On Wed, Oct 13, 2010 at 8:46 PM, George P. Stathis > <[email protected]>wrote: > >> I'm running this locally, so I have hbase and pig running on my dev box. I >> used to be able to connect just fine when running 0.20.6. We are in the >> process of migrating to 0.89 and I was testing our pig scripts which is when >> I found out that it wasn't working for me. >> >> Did you have to do anything special to get pig to work? >> >> >> On Wed, Oct 13, 2010 at 6:31 PM, Dmitriy Ryaboy <[email protected]>wrote: >> >>> George, >>> I tested it (though not very extensively) on hbase-0.89, which is what we >>> run in production. >>> Are you able to connect to hbase from the machine you are running pig on? >>> >>> -Dmitriy >>> >>> On Wed, Oct 13, 2010 at 1:08 PM, George Stathis <[email protected]> >>> wrote: >>> >>> > Hey folks, I've been trying HBaseStorage 0.8.0 trunk with hbase-0.89 >>> and it >>> > does not seem to work. It gets stuck at: >>> > >>> > [...] >>> > 2010-10-13 14:58:44,064 [Thread-4] INFO >>> org.apache.zookeeper.ClientCnxn - >>> > zookeeper.disableAutoWatchReset is false >>> > 2010-10-13 14:58:44,182 [Thread-4-SendThread] INFO >>> > org.apache.zookeeper.ClientCnxn - Attempting connection to server >>> > localhost/127.0.0.1:2181 >>> > 2010-10-13 14:58:44,188 [Thread-4-SendThread] INFO >>> > org.apache.zookeeper.ClientCnxn - Priming connection to >>> > java.nio.channels.SocketChannel[connected >>> > local=/127.0.0.1:54359remote=localhost/ >>> > 127.0.0.1:2181] >>> > 2010-10-13 14:58:44,191 [Thread-4-SendThread] INFO >>> > org.apache.zookeeper.ClientCnxn - Server connection successful >>> > >>> > and stays there. Has anyone tried running it against hbase 0.89 or is >>> > 0.20.6 >>> > the only last supported version? >>> > >>> > -GS >>> > >>> >> >> >
