Yeah this is a real thing, thanks for providing the patch. I added some comments on the ticket -- I am concerned not all Pig users are ready to switch over to a hadoop-with-appends dependency. A shim layer may be required again.
Let's continue the discussion on PIG-1680 in the Jira, yeah? -D On Thu, Oct 14, 2010 at 9:18 AM, George P. Stathis <[email protected]>wrote: > Dmitriy, see https://issues.apache.org/jira/browse/PIG-1680 and let me > know > what you think. I don't think the current trunk can really work against > hbase 0.89 using an HBaseStorage compiled against the hbase 0.20.6 API. > Locally at least, a 0.20.6 client cannot connect to a 0.89 instance for me. > We had the same issue in our application's DAOs and we had to re-compile > them against the 0.89 API. > > Once I did that with the patch attached to PIG-1680, my pig scripts started > working again. > > -GS > > On Wed, Oct 13, 2010 at 10:29 PM, George P. Stathis <[email protected] > >wrote: > > > Update: wait for it long enough and this is the resulting stack trace: > > > > 2010-10-13 22:01:54,791 [Thread-4] INFO org.apache.zookeeper.ZooKeeper - > > Initiating client connection, host=localhost:2181 sessionTimeout=60000 > > > watcher=org.apache.hadoop.hbase.client.hconnectionmanager$clientzkwatc...@14cb754f > > 2010-10-13 22:01:54,792 [Thread-4] INFO org.apache.zookeeper.ClientCnxn > - > > zookeeper.disableAutoWatchReset is false > > 2010-10-13 22:01:54,820 [Thread-4-SendThread] INFO > > org.apache.zookeeper.ClientCnxn - Attempting connection to server > > localhost/fe80:0:0:0:0:0:0:1%1:2181 > > 2010-10-13 22:01:54,832 [Thread-4-SendThread] INFO > > org.apache.zookeeper.ClientCnxn - Priming connection to > > java.nio.channels.SocketChannel[connected > local=/fe80:0:0:0:0:0:0:1%1:57908 > > remote=localhost/fe80:0:0:0:0:0:0:1%1:2181] > > 2010-10-13 22:01:54,850 [Thread-4-SendThread] INFO > > org.apache.zookeeper.ClientCnxn - Server connection successful > > 2010-10-13 22:01:54,952 [main] INFO > > > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > > - 0% complete > > 2010-10-13 22:25:45,646 [main] INFO > > > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > > - job null has failed! Stop running all dependent jobs > > 2010-10-13 22:25:45,714 [main] WARN > org.apache.pig.tools.pigstats.JobStats > > - unable to get input counter for influencers > > 2010-10-13 22:25:45,718 [main] WARN > org.apache.pig.tools.pigstats.JobStats > > - unable to get input counter for channels > > 2010-10-13 22:25:45,719 [main] INFO > > > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > > - 100% complete > > 2010-10-13 22:25:45,795 [main] ERROR > org.apache.pig.tools.pigstats.PigStats > > - ERROR 2118: Timed out trying to locate root region > > 2010-10-13 22:25:45,795 [main] ERROR > > org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed! > > 2010-10-13 22:25:45,795 [main] INFO > org.apache.pig.tools.pigstats.PigStats > > - Detected Local mode. Stats reported below may be incomplete > > 2010-10-13 22:25:45,797 [main] INFO > org.apache.pig.tools.pigstats.PigStats > > - Script Statistics: > > > > HadoopVersion PigVersion UserId StartedAt FinishedAt Features > > 0.20.2 0.8.0-SNAPSHOT gstathis 2010-10-13 22:01:52 2010-10-13 22:25:45 > > HASH_JOIN,FILTER > > > > Failed! > > > > Failed Jobs: > > JobId Alias Feature Message Outputs > > N/A allinfs,allinfs_strings,channels,infs,infsAndChannels,suspects > > HASH_JOIN Message: org.apache.pig.backend.executionengine.ExecException: > > ERROR 2118: Timed out trying to locate root region > > at > > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:280) > > at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885) > > at > > org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779) > > at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730) > > at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378) > > at > > > org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247) > > at > > org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279) > > at java.lang.Thread.run(Thread.java:637) > > Caused by: org.apache.hadoop.hbase.client.NoServerForRegionException: > Timed > > out trying to locate root region > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:983) > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:625) > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:601) > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:670) > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:630) > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:601) > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:670) > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:634) > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:601) > > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:134) > > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:112) > > at > > > org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:289) > > at > > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:261) > > ... 7 more > > > > > > On Wed, Oct 13, 2010 at 8:46 PM, George P. Stathis <[email protected] > >wrote: > > > >> I'm running this locally, so I have hbase and pig running on my dev box. > I > >> used to be able to connect just fine when running 0.20.6. We are in the > >> process of migrating to 0.89 and I was testing our pig scripts which is > when > >> I found out that it wasn't working for me. > >> > >> Did you have to do anything special to get pig to work? > >> > >> > >> On Wed, Oct 13, 2010 at 6:31 PM, Dmitriy Ryaboy <[email protected] > >wrote: > >> > >>> George, > >>> I tested it (though not very extensively) on hbase-0.89, which is what > we > >>> run in production. > >>> Are you able to connect to hbase from the machine you are running pig > on? > >>> > >>> -Dmitriy > >>> > >>> On Wed, Oct 13, 2010 at 1:08 PM, George Stathis <[email protected]> > >>> wrote: > >>> > >>> > Hey folks, I've been trying HBaseStorage 0.8.0 trunk with hbase-0.89 > >>> and it > >>> > does not seem to work. It gets stuck at: > >>> > > >>> > [...] > >>> > 2010-10-13 14:58:44,064 [Thread-4] INFO > >>> org.apache.zookeeper.ClientCnxn - > >>> > zookeeper.disableAutoWatchReset is false > >>> > 2010-10-13 14:58:44,182 [Thread-4-SendThread] INFO > >>> > org.apache.zookeeper.ClientCnxn - Attempting connection to server > >>> > localhost/127.0.0.1:2181 > >>> > 2010-10-13 14:58:44,188 [Thread-4-SendThread] INFO > >>> > org.apache.zookeeper.ClientCnxn - Priming connection to > >>> > java.nio.channels.SocketChannel[connected > >>> > local=/127.0.0.1:54359remote=localhost/ > >>> > 127.0.0.1:2181] > >>> > 2010-10-13 14:58:44,191 [Thread-4-SendThread] INFO > >>> > org.apache.zookeeper.ClientCnxn - Server connection successful > >>> > > >>> > and stays there. Has anyone tried running it against hbase 0.89 or is > >>> > 0.20.6 > >>> > the only last supported version? > >>> > > >>> > -GS > >>> > > >>> > >> > >> > > >
