I got a similar problem. I got it to kick into life by putting hbase-site.xml and hbase-default.xml in the same directory as the binaries. Looking at HBaseConfiguration it wants them to be in the pwd - on lines 49 and 50:
http://github.com/apache/hbase/blob/tags/0.20.1/src/java/org/apache/hadoop/hbase/HBaseConfiguration.java HTH -----Original Message----- From: Chris Bates [mailto:christopher.andrew.ba...@gmail.com] Sent: Sat 1/23/2010 12:42 AM To: hbase-user@hadoop.apache.org Subject: Re: Config Problems with HBase and Jetty So I've been still trying to work this problem out and haven't had any success. Here is another pastebin of the issues: http://pastebin.com/m2e19f84b So basically here is what I'm trying to do: 1. Run HBase Java API (0.20.1) from a Jetty Webserver (setup on 172.16.1.95:8888). I have handlers that are feeding objects that contain the different API calls I want to make. The handlers are setup with Spring. 2. The application is built and then runs after building. I have stared at my build.xml file many times and I'm sure hbase-site.xml and hbase-default.xml are included in the runtime conf directories, and the jars that I need are all in my runtime lib directory. I can post screenshots, but I'm sure they are in my classpath. 3. I'm running the program on 172.16.1.95. In the hbase-site.xml, my zookeepers are 172.16.1.46, 172.16.1.95, 172.16.1.96. My regionservers are just 172.16.1.95 and 172.16.1.96 (I sorta forget how I originally set up the system, so my regionserver file could possibly be another source of error). 4. In a moment of desperation, I just decided to include ALL of Hbase's conf files in my runtime conf directory. I get a different response and the system hangs (doesn't return anything and has a loading sign). Here is a thread dump for the 95 regionserver box. http://pastebin.com/m1feb7a8f. Here is the output I see at the command line: http://pastebin.com/ma6e7ef7 Are there any Web-server API configuration setups I can follow? Should I upgrade to 0.20.2? Should I try another web server (Tomcat?). Thanks again for the help On Wed, Jan 20, 2010 at 8:04 PM, stack <st...@duboce.net> wrote: > So, pardon me, I'm a little confused. The thread dump below looks like a > bunch of handlers waiting on something to happen. The hbase web ui looks > healthy. You are trying to embed hbase client inside a jetty webapp, > right? > > Looking at this, http://pastebin.com/m3147adf1, this looks wrong: > > > 1. [exec] 2010-01-20 16:13:00.769::INFO: Started SocketConnector@ > 0.0.0.0:8888 > 2. [exec] 16:13:06,133 DEBUG [24109...@qtp-15206466-0 > ,Configuration] > java.io.IOException< > http://www.google.com/search?hl=en&q=allinurl%3AIOException+java.sun.com&btnI=I%27m%20Feeling%20Lucky > >: > config() > 3. [exec] at org.apache.hadoop.conf.Configuration.<init>( > Configuration.java:210) > 4. [exec] at org.apache.hadoop.conf.Configuration.<init>( > Configuration.java:197) > 5. [exec] at org.apache.hadoop.hbase.HBaseConfiguration.<init>( > HBaseConfiguration.java:33) > 6. [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler. > java:25) > 7. [exec] at org.mortbay.jetty.handler.HandlerWrapper.handle( > HandlerWrapper.java:152) > 8. [exec] at org.mortbay.jetty.Server.handle(Server.java:326) > 9. [exec] at org.mortbay.jetty.HttpConnection.handleRequest( > HttpConnection.java:536) > 10. [exec] at org.mortbay.jetty.HttpConnection$RequestHandler. > headerComplete(HttpConnection.java:913) > 11. [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser. > java:539) > 12. [exec] at org.mortbay.jetty.HttpParser.parseAvailable( > HttpParser.java:212) > 13. [exec] at org.mortbay.jetty.HttpConnection.handle( > HttpConnection.java:405) > 14. [exec] at org.mortbay.jetty.bio.SocketConnector$Connection. > run(SocketConnector.java:228) > 15. [exec] at org.mortbay.thread.QueuedThreadPool$PoolThread.run > (QueuedThreadPool.java:582) > > > > > > > This is as though you still do not have hbase conf directory on the jetty > CLASSPATH? > > This is good: "Connecting to /172.16.1.96:6002" > > This is the right location? It got this from hbase-site.xml? Maybe its > missing hbase-default.xml? > > Oh, I see you have DEBUG logging on for RPC. Do you have all DEBUG on for > all hadoop packages? It looks like stuff is working? > > St.Ack > > > On Wed, Jan 20, 2010 at 4:12 PM, Chris Bates < > christopher.andrew.ba...@gmail.com> wrote: > > > What exactly do you mean by client exceptions? Or where can I find them? > I > > pastebin'd the exceptions I got from the command line. The web browser is > > blank and just has a loading sign until I kill the process. If I look at > > the Hbase Web UI from the crunch2 box where I ran the program, everything > > seems normal, but I'll paste that: > > > > Web UI: > > http://pastebin.com/mef9a432 > > > > Thread Dump: > > http://pastebin.com/m76022dea > > > > On Wed, Jan 20, 2010 at 6:05 PM, stack <st...@duboce.net> wrote: > > > > > I was thinking hadoop perms. But if shell works, then its probably > fine. > > > Can you pastebin client exceptions? Thanks, > > > St.Ack > > > > > > On Wed, Jan 20, 2010 at 1:32 PM, Chris Bates < > > > christopher.andrew.ba...@gmail.com> wrote: > > > > > > > Yeah, we're just using the default so no zoo.cfg. Permissions are > fine > > > as > > > > I > > > > can ssh into any other hadoop box without password. Although it > looks > > > like > > > > permissions aren't set on the log directory. I'm currently VPN'd, so > > > maybe > > > > its a networking issue?? > > > > > > > > Pastebin: http://pastebin.com/m3147adf1 > > > > > > > > Hbase shell is working: > > > > hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'], LIMIT=>5} > > > > ROW COLUMN+CELL > > > > > > > > -10095526042667 column=user:theme, > > > timestamp=-10095526042667, > > > > value=Frost > > > > -10095526042683 column=user:theme, > > > timestamp=-10095526042683, > > > > value=Frost > > > > -10095526042854 column=user:theme, > > > timestamp=-10095526042854, > > > > value=Frost > > > > -10095526042870 column=user:theme, > > > timestamp=-10095526042870, > > > > value=Frost > > > > 5 row(s) in 0.2570 seconds > > > > > > > > Jetty is working: > > > > > > > > // Substitute HBase config for test stringbuilder > > > > > > > > StringBuilder builder = new StringBuilder(); > > > > > > > > builder.append("Blah blah blah"); > > > > > > > > response.getOutputStream().write( > > > > builder.toString().getBytes()); > > > > > > > > Outputs "Blah blah blah" to the screen. > > > > > > > > > > > > > > > > On Wed, Jan 20, 2010 at 4:18 PM, stack <st...@duboce.net> wrote: > > > > > > > > > On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group < > > > > > robert.gib...@vodafone.com> wrote: > > > > > > > > > > > > > > > > > Try putting the directory holding zoo.cfg on the classpath - you > > have > > > a > > > > > > zoo.cfg file, right? > > > > > > > > > > > > > > > > Default is to read zoo configuration from hbase-site.xml -- e.g. > > > > > ensemble/quorum members -- but if a zoo.cfg is present, we'll read > > that > > > > > ahead of hbase-site.xml. > > > > > St.Ack > > > > > > > > > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > From: saint....@gmail.com on behalf of stack > > > > > > Sent: Wed 1/20/2010 9:53 PM > > > > > > To: hbase-user@hadoop.apache.org > > > > > > Subject: Re: Config Problems with HBase and Jetty > > > > > > > > > > > > Can you pastebin the below? Its hard to read in email. Maybe > its > > a > > > > > > permissions prob? I see lots of 'from an unknown user got > value'. > > > Can > > > > > you > > > > > > get to your hbase cluster using hbase shell ok? From host > running > > > > > jetty? > > > > > > > > > > > > St.Ack > > > > > > > > > > > > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates < > > > > > > christopher.andrew.ba...@gmail.com> wrote: > > > > > > > > > > > > > Ah. good catch...getting more errors still.... > > > > > > > > > > > > > > [exec] at > > > > > > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210) > > > > > > > [exec] at > > > > > > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197) > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33) > > > > > > > [exec] at > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25) > > > > > > > [exec] at > > > > > > > > > > > > > > > > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > > > > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326) > > > > > > > [exec] at > > > > > > > > > > > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536) > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913) > > > > > > > [exec] at > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539) > > > > > > > [exec] at > > > > > > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > > > > > > > [exec] at > > > > > > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405) > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > > > > > > > [exec] > > > > > > > [exec] 15:33:31,226 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > > Client > > > > > > > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 > > > 18:48 > > > > > GMT > > > > > > > [exec] 15:33:31,227 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:host.name=crunch2.local > > > > > > > [exec] 15:33:31,227 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:java.version=1.6.0_14 > > > > > > > [exec] 15:33:31,228 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:java.vendor=Sun Microsystems Inc. > > > > > > > [exec] 15:33:31,228 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre > > > > > > > [exec] 15:33:31,228 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar > > > > > > > [exec] 15:33:31,229 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib > > > > > > > [exec] 15:33:31,229 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:java.io.tmpdir=/tmp > > > > > > > [exec] 15:33:31,230 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:java.compiler=<NA> > > > > > > > [exec] 15:33:31,230 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:os.name=Linux > > > > > > > [exec] 15:33:31,230 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:os.arch=i386 > > > > > > > [exec] 15:33:31,231 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:os.version=2.6.28-11-generic > > > > > > > [exec] 15:33:31,232 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:user.name=hadoop > > > > > > > [exec] 15:33:31,232 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:user.home=/home/hadoop > > > > > > > [exec] 15:33:31,233 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > Client > > > > > > > environment:user.dir=/var/www/jetty/hbase/build/jettycab > > > > > > > [exec] 15:33:31,236 INFO [24109...@qtp-15206466-0 > > ,ZooKeeper] > > > > > > > Initiating client connection, connectString=localhost:2181 > > > > > > > sessionTimeout=60000 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > watcher=org.apache.hadoop.hbase.client.hconnectionmanager$clientzkwatc...@5fcf29 > > > > > > > [exec] 15:33:31,241 INFO [24109...@qtp-15206466-0 > > ,ClientCnxn] > > > > > > > zookeeper.disableAutoWatchReset is false > > > > > > > [exec] 15:33:31,291 INFO > [24109...@qtp-15206466-0-sendthread > > > > > > > ,ClientCnxn] > > > > > > > Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181 > > > > > > > [exec] 15:33:31,302 INFO > [24109...@qtp-15206466-0-sendthread > > > > > > > ,ClientCnxn] > > > > > > > Priming connection to java.nio.channels.SocketChannel[connected > > > > > > > local=/0:0:0:0:0:0:0:1:41216 > > remote=localhost/0:0:0:0:0:0:0:1:2181] > > > > > > > [exec] 15:33:31,320 INFO > [24109...@qtp-15206466-0-sendthread > > > > > > > ,ClientCnxn] > > > > > > > Server connection successful > > > > > > > [exec] 15:33:31,379 DEBUG > > > > > > > [24109...@qtp-15206466-0-eventthread > > > > > ,HConnectionManager$ClientZKWatcher] > > > > > > > Got ZooKeeper event, state: SyncConnected, type: None, path: > null > > > > > > > [exec] 15:33:31,386 DEBUG > [24109...@qtp-15206466-0-sendthread > > > > > > > ,ClientCnxn] > > > > > > > Reading reply sessionid:0x326344ba5640005, packet:: > > clientPath:null > > > > > > > serverPath:null finished:false header:: -8,101 replyHeader:: > > > -8,80,0 > > > > > > > request:: 0,v{},v{},v{} response:: null > > > > > > > [exec] 15:33:31,404 DEBUG > [24109...@qtp-15206466-0-sendthread > > > > > > > ,ClientCnxn] > > > > > > > Reading reply sessionid:0x326344ba5640005, packet:: > > clientPath:null > > > > > > > serverPath:null finished:false header:: 1,1 replyHeader:: > > > 1,81,-110 > > > > > > > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response:: > > > > > > > [exec] 15:33:31,438 DEBUG > [24109...@qtp-15206466-0-sendthread > > > > > > > ,ClientCnxn] > > > > > > > Reading reply sessionid:0x326344ba5640005, packet:: > > clientPath:null > > > > > > > serverPath:null finished:false header:: 2,3 replyHeader:: > 2,81,0 > > > > > > > request:: > > > > > > > '/hbase/safe-mode,F response:: > > > > > > > > > > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24} > > > > > > > [exec] 15:33:31,453 DEBUG > [24109...@qtp-15206466-0-sendthread > > > > > > > ,ClientCnxn] > > > > > > > Reading reply sessionid:0x326344ba5640005, packet:: > > clientPath:null > > > > > > > serverPath:null finished:false header:: 3,4 replyHeader:: > 3,81,0 > > > > > > > request:: > > > > > > > '/hbase/root-region-server,F response:: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26} > > > > > > > [exec] 15:33:31,454 DEBUG [24109...@qtp-15206466-0 > > > > > ,ZooKeeperWrapper] > > > > > > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020 > > > > > > > [exec] 15:33:31,677 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > The > > > > > > > ping interval is60000ms. > > > > > > > [exec] 15:33:31,792 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > > > Connecting to /172.16.1.96:60020 > > > > > > > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.96:60020 from an unknown user: > starting, > > > > > having > > > > > > > connections 1 > > > > > > > [exec] 15:33:31,843 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > IPC > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown > > user > > > > > > sending > > > > > > > #0 > > > > > > > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.96:60020 from an unknown user got > value > > #0 > > > > > > > [exec] 15:33:31,913 DEBUG [24109...@qtp-15206466-0 > ,HbaseRPC] > > > > Call: > > > > > > > getProtocolVersion 139 > > > > > > > [exec] 15:33:31,914 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > IPC > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown > > user > > > > > > sending > > > > > > > #1 > > > > > > > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.96:60020 from an unknown user got > value > > #1 > > > > > > > [exec] 15:33:31,941 DEBUG [24109...@qtp-15206466-0 > ,HbaseRPC] > > > > Call: > > > > > > > getRegionInfo 28 > > > > > > > [exec] 15:33:31,942 DEBUG > > > > > > > [24109...@qtp-15206466-0,HConnectionManager$TableServers] > > > > > > > Found ROOT at 172.16.1.96:60020 > > > > > > > [exec] 15:33:31,944 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > IPC > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown > > user > > > > > > sending > > > > > > > #2 > > > > > > > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.96:60020 from an unknown user got > value > > #2 > > > > > > > [exec] 15:33:31,951 DEBUG [24109...@qtp-15206466-0 > ,HbaseRPC] > > > > Call: > > > > > > > getClosestRowBefore 8 > > > > > > > [exec] 15:33:32,004 DEBUG > > > > > > > [24109...@qtp-15206466-0,HConnectionManager$TableServers] > > > > > > > Cached location address: 172.16.1.95:60020, regioninfo: REGION > > => > > > > > {NAME > > > > > > => > > > > > > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => > 1028785192, > > > > TABLE > > > > > > => > > > > > > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE => > > > '16384', > > > > > > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647', > > > > > COMPRESSION > > > > > > => > > > > > > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => > > 'false', > > > > > > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10', > > > > COMPRESSION > > > > > => > > > > > > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY => > > > > 'false', > > > > > > > BLOCKCACHE => 'false'}]}} > > > > > > > [exec] 15:33:32,006 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > > > Connecting to /172.16.1.95:60020 > > > > > > > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.95:60020 from an unknown user: > starting, > > > > > having > > > > > > > connections 2 > > > > > > > [exec] 15:33:32,016 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > IPC > > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown > > user > > > > > > sending > > > > > > > #3 > > > > > > > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.95:60020 from an unknown user got > value > > #3 > > > > > > > [exec] 15:33:32,020 DEBUG [24109...@qtp-15206466-0 > ,HbaseRPC] > > > > Call: > > > > > > > getProtocolVersion 14 > > > > > > > [exec] 15:33:32,021 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > IPC > > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown > > user > > > > > > sending > > > > > > > #4 > > > > > > > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.95:60020 from an unknown user got > value > > #4 > > > > > > > [exec] 15:33:32,177 DEBUG [24109...@qtp-15206466-0 > ,HbaseRPC] > > > > Call: > > > > > > > getClosestRowBefore 157 > > > > > > > [exec] 15:33:32,179 DEBUG > > > > > > > [24109...@qtp-15206466-0,HConnectionManager$TableServers] > > > > > > > Cached location address: 172.16.1.96:60020, regioninfo: REGION > > => > > > > > {NAME > > > > > > => > > > > > > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY => > '1262239352230', > > > > > ENCODED > > > > > > > => > > > > > > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME => > > > 'search', > > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', > > > > BLOCKSIZE > > > > > => > > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => > > > > 'user', > > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', > > > > BLOCKSIZE > > > > > => > > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}} > > > > > > > [exec] 15:33:32,189 DEBUG [24109...@qtp-15206466-0 > > > > > > > ,HTable$ClientScanner] > > > > > > > Creating scanner over Guts starting at key '' > > > > > > > [exec] 15:33:32,190 DEBUG [24109...@qtp-15206466-0 > > > > > > > ,HTable$ClientScanner] > > > > > > > Advancing internal scanner to startKey at '' > > > > > > > [exec] 15:33:32,191 DEBUG > > > > > > > [24109...@qtp-15206466-0,HConnectionManager$TableServers] > > > > > > > Cache hit for row <> in tableName Guts: location server > > > > > > 172.16.1.96:60020, > > > > > > > location region name Guts,,1262665364102 > > > > > > > [exec] 15:33:32,192 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > IPC > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown > > user > > > > > > sending > > > > > > > #5 > > > > > > > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.96:60020 from an unknown user got > value > > #5 > > > > > > > [exec] 15:33:32,222 DEBUG [24109...@qtp-15206466-0 > ,HbaseRPC] > > > > Call: > > > > > > > openScanner 30 > > > > > > > [exec] 15:33:32,224 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > IPC > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown > > user > > > > > > sending > > > > > > > #6 > > > > > > > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.96:60020 from an unknown user got > value > > #6 > > > > > > > [exec] 15:33:32,253 DEBUG [24109...@qtp-15206466-0 > ,HbaseRPC] > > > > Call: > > > > > > > next > > > > > > > 30 > > > > > > > [exec] 15:33:32,260 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > IPC > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown > > user > > > > > > sending > > > > > > > #7 > > > > > > > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.96:60020 from an unknown user got > value > > #7 > > > > > > > [exec] 15:33:32,287 DEBUG [24109...@qtp-15206466-0 > ,HbaseRPC] > > > > Call: > > > > > > > next > > > > > > > 28 > > > > > > > [exec] 15:33:32,288 DEBUG [24109...@qtp-15206466-0 > > > ,HBaseClient] > > > > > IPC > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown > > user > > > > > > sending > > > > > > > #8 > > > > > > > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to / > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client > > > (47) > > > > > > > connection to /172.16.1.96:60020 from an unknown user got > value > > #8 > > > > > > > [exec] 15:33:32,315 DEBUG [24109...@qtp-15206466-0 > ,HbaseRPC] > > > > Call: > > > > > > > next > > > > > > > 27 > > > > > > > > > > > > > > Then this scanner output seems to continue forever and it just > > > hangs. > > > > > > I'm > > > > > > > not really sure what the errors mean... > > > > > > > > > > > > > > > > > > > > > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net> > wrote: > > > > > > > > > > > > > > > Is zookeeper jar on your CLASSPATH? > > > > > > > > > > > > > > > > [exec] java.lang.NoClassDefFoundError: > > > > org/apache/zookeeper/Watcher > > > > > > > > > > > > > > > > You code looks fine. > > > > > > > > > > > > > > > > St.Ack > > > > > > > > > > > > > > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates < > > > > > > > > christopher.andrew.ba...@gmail.com> wrote: > > > > > > > > > > > > > > > > > Hi, > > > > > > > > > > > > > > > > > > We're building an analytics server with HBase using Jetty. > I > > > > have > > > > > > > > > experimented with the Thrift API + PHP over the past few > days > > > and > > > > > got > > > > > > > it > > > > > > > > > working, but needed the filter functionality which has not > > been > > > > > > > released > > > > > > > > > yet. So I decided to switch to the Java API and run it > with > > a > > > > > Jetty > > > > > > > > > server. > > > > > > > > > > > > > > > > > > My Jetty server is setup on crunch2.in.escapemg.com:8888. > > > > > > > > > > > > > > > > > > Hbase is setup on the same machine, with all the > > configuration > > > > > > settings > > > > > > > > > according to the "Getting Started" guide. We are using > Hbase > > > > > version > > > > > > > > > 0.20.1. > > > > > > > > > > > > > > > > > > Just doing a quick scanning test with this code: > > > > > > > > > > > > > > > > > > HBaseConfiguration config = new HBaseConfiguration(); > > > > > > > > > HTable table = new HTable(config, "Guts"); > > > > > > > > > Scan s = new Scan(); > > > > > > > > > > > > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme")); > > > > > > > > > ResultScanner scanner = table.getScanner(s); > > > > > > > > > int count = 0; > > > > > > > > > int limit = 10; > > > > > > > > > try { > > > > > > > > > for (Result rr = scanner.next(); rr != null; > > rr > > > = > > > > > > > > > scanner.next()) { > > > > > > > > > if (count <= limit) { > > > > > > > > > response.getOutputStream().write( > > > > > rr.getRow() > > > > > > ); > > > > > > > > > count++; > > > > > > > > > } > > > > > > > > > } > > > > > > > > > } finally { > > > > > > > > > scanner.close(); > > > > > > > > > } > > > > > > > > > > > > > > > > > > > > > > > > > > > I get this error, which states (I think) that the HBase is > > > > throwing > > > > > a > > > > > > > > > connection error: > > > > > > > > > > > > > > > > > > [exec] 14:56:14,197 DEBUG [24109...@qtp-15206466-0 > > > > ,Configuration] > > > > > > > > > java.io.IOException: config() > > > > > > > > > [exec] at > > > > > > > > > > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210) > > > > > > > > > [exec] at > > > > > > > > > > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33) > > > > > > > > > [exec] at > > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > > > > > > > > > [exec] at > > org.mortbay.jetty.Server.handle(Server.java:326) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913) > > > > > > > > > [exec] at > > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539) > > > > > > > > > [exec] at > > > > > > > > > > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > > > > > > > > > [exec] at > > > > > > > > > > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > > > > > > > > > [exec] > > > > > > > > > [exec] 2010-01-20 14:56:14.697::WARN: / > > > > > > > > > [exec] java.lang.NoClassDefFoundError: > > > > > > org/apache/zookeeper/Watcher > > > > > > > > > [exec] at java.lang.ClassLoader.defineClass1(Native > > Method) > > > > > > > > > [exec] at > > > > > java.lang.ClassLoader.defineClass(ClassLoader.java:621) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124) > > > > > > > > > [exec] at > > > > > > > > java.net.URLClassLoader.defineClass(URLClassLoader.java:260) > > > > > > > > > [exec] at > > > > > > > java.net.URLClassLoader.access$000(URLClassLoader.java:56) > > > > > > > > > [exec] at > > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:195) > > > > > > > > > [exec] at > > > java.security.AccessController.doPrivileged(Native > > > > > > > Method) > > > > > > > > > [exec] at > > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188) > > > > > > > > > [exec] at > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307) > > > > > > > > > [exec] at > > > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > > > > > > > > > [exec] at > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252) > > > > > > > > > [exec] at > > > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556) > > > > > > > > > [exec] at > > > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127) > > > > > > > > > [exec] at > > > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105) > > > > > > > > > [exec] at > > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > > > > > > > > > [exec] at > > org.mortbay.jetty.Server.handle(Server.java:326) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913) > > > > > > > > > [exec] at > > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539) > > > > > > > > > [exec] at > > > > > > > > > > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > > > > > > > > > [exec] at > > > > > > > > > > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > > > > > > > > > [exec] at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > > > > > > > > > [exec] Caused by: java.lang.ClassNotFoundException: > > > > > > > > > org.apache.zookeeper.Watcher > > > > > > > > > [exec] at > > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:200) > > > > > > > > > [exec] at > > > java.security.AccessController.doPrivileged(Native > > > > > > > Method) > > > > > > > > > [exec] at > > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188) > > > > > > > > > [exec] at > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307) > > > > > > > > > [exec] at > > > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > > > > > > > > > [exec] at > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252) > > > > > > > > > [exec] at > > > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320) > > > > > > > > > [exec] ... 35 more > > > > > > > > > > > > > > > > > > > > > > > > > > > After doing a mailing list search, it seemed that other > > > > > configuration > > > > > > > > > problems were fixed by upgrading to 0.20.2 which I have not > > yet > > > > > done. > > > > > > > Is > > > > > > > > > this the problem or is there something simple I am > > overlooking? > > > > I > > > > > > have > > > > > > > > > also > > > > > > > > > added my hbase-site.xml and hbase-default.xml to my lib and > > > conf > > > > > > > > > directories > > > > > > > > > to my working classpath. > > > > > > > > > > > > > > > > > > I am confused because I was able to connect via thrift, and > I > > > > also > > > > > > have > > > > > > > a > > > > > > > > > BulkImporter MapReduce script to load the logging data into > > > HBase > > > > > > that > > > > > > > > > works > > > > > > > > > fine, but have been unable to locate my error in this case. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
