thanks ted
On Sun, Apr 27, 2014 at 11:06 PM, Ted Yu <[email protected]> wrote: > I am adding cdh users mailing list where you would get good response to the > issue below. > > Cheers > > > On Sun, Apr 27, 2014 at 10:30 AM, yeshwanth kumar <[email protected] > >wrote: > > > hi ted, > > > > i replaced the hbase 0.94.7 with cdh 0.94.6 version. > > i don't see any errors in regionservers log but i am getting this > > exception in my tomcat webapp. > > > > javax.servlet.ServletException: java.lang.NoClassDefFoundError: > > org/apache/hadoop/net/SocketInputWrapper > > > > > com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:420) > > > > > com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:538) > > > > > com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:716) > > javax.servlet.http.HttpServlet.service(HttpServlet.java:728) > > > > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > > > > *root cause* > > > > java.lang.NoClassDefFoundError: org/apache/hadoop/net/SocketInputWrapper > > > > > org.apache.hadoop.hbase.ipc.HBaseClient.createConnection(HBaseClient.java:255) > > > > > org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1120) > > > org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:980) > > > > > org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:86) > > com.sun.proxy.$Proxy66.getProtocolVersion(Unknown Source) > > > > > org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:138) > > > > org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:208) > > > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1358) > > > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1317) > > > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1304) > > > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:990) > > > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:885) > > > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:987) > > > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:889) > > > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:846) > > > org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:270) > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:210) > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169) > > > > > com.serendio.penton.rest.server.CsvMgmtEndPoint.<init>(CsvMgmtEndPoint.java:76) > > sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > > Method) > > > > > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > > > > > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > > java.lang.reflect.Constructor.newInstance(Constructor.java:526) > > > > > com.sun.jersey.server.spi.component.ResourceComponentConstructor._construct(ResourceComponentConstructor.java:191) > > > > > com.sun.jersey.server.spi.component.ResourceComponentConstructor.construct(ResourceComponentConstructor.java:179) > > > > > com.sun.jersey.server.impl.resource.PerRequestFactory$PerRequest._getInstance(PerRequestFactory.java:182) > > > > > com.sun.jersey.server.impl.resource.PerRequestFactory$AbstractPerRequest.getInstance(PerRequestFactory.java:144) > > > > > com.sun.jersey.server.impl.application.WebApplicationContext.getResource(WebApplicationContext.java:238) > > > > > com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:83) > > > > > com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) > > > > > com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84) > > > > > com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1511) > > > > > com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1442) > > > > > com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1391) > > > > > com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1381) > > > > > com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416) > > > > > com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:538) > > > > > com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:716) > > javax.servlet.http.HttpServlet.service(HttpServlet.java:728) > > > > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > > > > > > here's the pom i specified > > > > <dependency> > > <groupId>org.apache.hbase</groupId> > > <artifactId>hbase</artifactId> > > <version>0.94.6-cdh4.5.0</version> > > <exclusions> > > <exclusion> > > <groupId> org.mortbay.jetty</groupId> > > <artifactId>jetty</artifactId> > > </exclusion> > > <exclusion> > > <groupId> org.mortbay.jetty</groupId> > > <artifactId>jetty-util</artifactId> > > </exclusion> > > <exclusion> > > <groupId> org.mortbay.jetty</groupId> > > <artifactId>jsp-api-2.1</artifactId> > > </exclusion> > > <exclusion> > > <groupId> org.mortbay.jetty</groupId> > > <artifactId>jsp-2.1</artifactId> > > </exclusion> > > <exclusion> > > <groupId> org.mortbay.jetty</groupId> > > <artifactId>servlet-api-2.5</artifactId> > > </exclusion> > > <exclusion> > > <groupId>tomcat</groupId> > > <artifactId>jasper-runtime</artifactId> > > </exclusion> > > <exclusion> > > <groupId>tomcat</groupId> > > <artifactId>jasper-compiler</artifactId> > > </exclusion> > > </exclusions> > > </dependency> > > > > can you help me out with this issue. > > > > thanks, > > yeshwanth. > > > > > > > > > > > > On Sun, Apr 27, 2014 at 10:32 PM, yeshwanth kumar <[email protected] > > >wrote: > > > > > here's the code snippet <http://pastebin.com/AGh7mTNT> > > > > > > thanks, > > > yeshwanth > > > > > > > > > On Sun, Apr 27, 2014 at 10:20 PM, Ted Yu <[email protected]> wrote: > > > > > >> Can you show us code snippet where you add filter to Scan object ? > > >> > > >> Thanks > > >> > > >> On Apr 27, 2014, at 9:43 AM, yeshwanth kumar <[email protected]> > > >> wrote: > > >> > > >> > hi ted, > > >> > > > >> > i am using fuzzyrow filter while scanning a table. > > >> > my cluster is running on HBase 0.94.6-cdh4.5.0 > > >> > but in my webapp i specified hbase 0.94.7. dependency. > > >> > > > >> > even after changing the dependency i still see the same error. > > >> > > > >> > thanks, > > >> > yeshwanth. > > >> > > > >> > > > >> > > > >> > > > >> > On Sun, Apr 27, 2014 at 10:03 PM, Ted Yu <[email protected]> > wrote: > > >> > > > >> >> Did the exception below happen when you were performing some query > on > > >> the > > >> >> region server ? > > >> >> > > >> >> Can you tell us a bit more whether your query uses FilterList ? > > >> >> > > >> >> Thanks > > >> >> > > >> >> > > >> >> On Sun, Apr 27, 2014 at 9:28 AM, yeshwanth kumar < > > >> [email protected] > > >> >>> wrote: > > >> >> > > >> >>> hi jean, > > >> >>> > > >> >>> i am using HBase 0.94.6-cdh4.5.0 > > >> >>> > > >> >>> i found this in regionservers log, > > >> >>> > > >> >>> org.apache.hadoop.hbase.io.HbaseObjectWritable > > >> >>> Error in readFields > > >> >>> java.lang.ClassCastException: > > >> >>> org.apache.hadoop.hbase.snapshot.HSnapshotDescription cannot be > cast > > >> to > > >> >>> org.apache.hadoop.hbase.filter.Filter > > >> >>> at > > >> >>> > > >> > > org.apache.hadoop.hbase.filter.FilterList.readFields(FilterList.java:276) > > >> >>> at org.apache.hadoop.hbase.client.Scan.readFields(Scan.java:591) > > >> >>> at > > >> >> > > >> > > > org.apache.hadoop.hbase.io.HbaseObjectWritable.readObject(HbaseObjectWritable.java:689) > > >> >>> at > > >> org.apache.hadoop.hbase.ipc.Invocation.readFields(Invocation.java:127) > > >> >>> at > > >> >> > > >> > > > org.apache.hadoop.hbase.ipc.HBaseServer$Connection.processData(HBaseServer.java:1313) > > >> >>> at > > >> >> > > >> > > > org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:1228) > > >> >>> at > > >> >> > > >> > > > org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:750) > > >> >>> at > > >> >> > > >> > > > org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.doRunLoop(HBaseServer.java:541) > > >> >>> at > > >> >> > > >> > > > org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:516) > > >> >>> at > > >> >> > > >> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > >> >>> at > > >> >> > > >> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > >> >>> at java.lang.Thread.run(Thread.java:744) > > >> >>> > > >> >>> how can i fix this dependency issue. > > >> >>> > > >> >>> > > >> >>> > > >> >>> > > >> >>> On Fri, Apr 25, 2014 at 9:06 PM, yeshwanth kumar < > > >> [email protected] > > >> >>>> wrote: > > >> >>> > > >> >>>> hi jean, > > >> >>>> > > >> >>>> i haven't written any piece of code to workaround znode, > > >> >>>> one of my rest endpoint in webapp reads data from hbase. > > >> >>>> it is giving me empty set. > > >> >>>> all if found in the logs is > > >> >>>> > > >> >>>> Reading reply sessionid:0x145974472760023, packet:: > clientPath:null > > >> >>>> serverPath:null finished:false header:: 42,4 replyHeader:: > > >> >>>> 42,77309411972,-101 request:: '/hbase/table/NCSVs,F response:: > > >> >>>> hconnection-0x145974472760023 Unable to get data of znode > > >> >>>> /hbase/table/NCSVs because node does not exist (not an error) > > >> >>>> > > >> >>>> this is what i found in zookeeper client > > >> >>>> > > >> >>>> *$[zk: localhost:2181(CONNECTED) 14] ls /hbase* > > >> >>>> *[splitlog, online-snapshot, unassigned, table94, > > root-region-server, > > >> >> rs, > > >> >>>> backup-masters, table, draining, master, shutdown, hbaseid]* > > >> >>>> > > >> >>>> > > >> >>>> -yeshwanth > > >> >>>> > > >> >>>> > > >> >>>> On Fri, Apr 25, 2014 at 8:18 PM, Jean-Marc Spaggiari < > > >> >>>> [email protected]> wrote: > > >> >>>> > > >> >>>>> Hi Yeshwanth, > > >> >>>>> > > >> >>>>> What is your webapp looking at the ZNode? If you should the Java > > >> >> client > > >> >>>>> and > > >> >>>>> not look at the ZNode. Not getting why it's looking there. Do yo > > >> >> uknow? > > >> >>>>> > > >> >>>>> JM > > >> >>>>> > > >> >>>>> > > >> >>>>> 2014-04-25 2:01 GMT-04:00 yeshwanth kumar < > [email protected] > > >: > > >> >>>>> > > >> >>>>>> hi matteo, > > >> >>>>>> > > >> >>>>>> my problem isn't solved yet. > > >> >>>>>> webapp isn't reading data from hbase. > > >> >>>>>> all i see in logs is znode /hbase/table/mytable doesn't exist. > > >> >>>>>> but all my tables are present in /hbase/table94/ > > >> >>>>>> > > >> >>>>>> so how can i fix this problem. > > >> >>>>>> > > >> >>>>>> thanks, > > >> >>>>>> yeshwanth > > >> >>>>>> > > >> >>>>>> > > >> >>>>>> > > >> >>>>>> > > >> >>>>>> On Tue, Apr 22, 2014 at 9:58 PM, Matteo Bertozzi < > > >> >>>>> [email protected] > > >> >>>>>>> wrote: > > >> >>>>>> > > >> >>>>>>> that is already done by the server. > > >> >>>>>>> The ZooKeeperWatcher.java is using conf.get( > > >> >>>>>>> "zookeeper.znode.masterTableEnableDisable", "table94")); > > >> >>>>>>> > > >> >>>>>>> anyway, why are you looking at the znodes? > > >> >>>>>>> a client application should never look at the znodes. > > >> >>>>>>> The znodes are only carrying transient informations used for > > >> >>>>> coordination > > >> >>>>>>> > > >> >>>>>>> Matteo > > >> >>>>>>> > > >> >>>>>>> > > >> >>>>>>> > > >> >>>>>>> On Tue, Apr 22, 2014 at 9:20 AM, yeshwanth kumar < > > >> >>>>> [email protected] > > >> >>>>>>>> wrote: > > >> >>>>>>> > > >> >>>>>>>> hi matteo, > > >> >>>>>>>> > > >> >>>>>>>> how do i specify hbase znode to use /hbase/table94 instead > of > > >> >>>>>>> /hbase/table > > >> >>>>>>>> > > >> >>>>>>>> thanks > > >> >>>>>>>> > > >> >>>>>>>> > > >> >>>>>>>> On Tue, Apr 22, 2014 at 9:40 PM, Matteo Bertozzi < > > >> >>>>>>> [email protected] > > >> >>>>>>>>> wrote: > > >> >>>>>>>> > > >> >>>>>>>>> On Tue, Apr 22, 2014 at 9:00 AM, yeshwanth kumar < > > >> >>>>>>> [email protected] > > >> >>>>>>>>>> wrote: > > >> >>>>>>>>> > > >> >>>>>>>>>> @matteo > > >> >>>>>>>>>> present znode is at /hbase/table where it is empty. > > >> >>>>>>>>>> where as all my tables are present in /hbase/table94 > > >> >>>>>>>>>> now webapp isn't reading the data from hbase. > > >> >>>>>>>>> > > >> >>>>>>>>> cdh 4.5.0 doesn't write in /hbase/table due to a > compatibility > > >> >>>>> issue > > >> >>>>>>>>> /hbase/table94 > > >> >>>>>>>>> is used. > > >> >>>>>>>>> (see HBASE-6710 for details) > > >> >>>>>>>>> > > >> >>>>>>>>> On Tue, Apr 22, 2014 at 6:56 PM, Matteo Bertozzi < > > >> >>>>>>>> [email protected] > > >> >>>>>>>>>> wrote: > > >> >>>>>>>>> > > >> >>>>>>>>>> > > >> >>>>>>>>>>> /hbase/table94 is a "compatibility" znode that replaces > > >> >>>>>>> /hbase/table > > >> >>>>>>>>>>> if you want more details take a look at HBASE-6710. > > >> >>>>>>>>>>> > > >> >>>>>>>>>>> what is the problem of looking into /hbase/table94 instead > > >> >>> of > > >> >>>>>>>>>> /hbase/table? > > >> >>>>>>>>>>> > > >> >>>>>>>>>>> Matteo > > >> >>>>>>>>>>> > > >> >>>>>>>>>>> > > >> >>>>>>>>>>> > > >> >>>>>>>>>>> On Tue, Apr 22, 2014 at 5:18 AM, yeshwanth kumar < > > >> >>>>>>>>> [email protected] > > >> >>>>>>>>>>>> wrote: > > >> >>>>>>>>>>> > > >> >>>>>>>>>>>> Hi, > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> i am running webapp written on jaxrs framework which > > >> >>>>> performs > > >> >>>>>>> CRUD > > >> >>>>>>>>>>>> opereations on hbase. > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> app was working fine till last week, > > >> >>>>>>>>>>>> now when i perform reading opeartion from hbase i don't > > >> >>> see > > >> >>>>>> any > > >> >>>>>>>>> data, > > >> >>>>>>>>>> i > > >> >>>>>>>>>>>> don't see any errors or exceptions but i found this > > >> >> lines > > >> >>> in > > >> >>>>>> the > > >> >>>>>>>> log > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> *""Unable to get data of znode /hbase/table/myTable > > >> >>> because > > >> >>>>>> node > > >> >>>>>>>> does > > >> >>>>>>>>>> not > > >> >>>>>>>>>>>> exist (not an error)"".* > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> i followed this< > > >> >>>>> https://blog.cloudera.com/blog/2013/10/what-are-hbase-znodes/> > > >> >>>>>>>>>>>> cloudera > > >> >>>>>>>>>>>> article about znodes and this is what i found, > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> *$[zk: localhost:2181(CONNECTED) 14] ls /hbase* > > >> >>>>>>>>>>>> *[splitlog, online-snapshot, unassigned, table94, > > >> >>>>>>>> root-region-server, > > >> >>>>>>>>>> rs, > > >> >>>>>>>>>>>> backup-masters, table, draining, master, shutdown, > > >> >>> hbaseid]* > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> all the tables were present in /hbase/table94, where as > > >> >>>>>>>> /hbase/table > > >> >>>>>>>>> is > > >> >>>>>>>>>>>> empty. > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> i know what is the problem now, > > >> >>>>>>>>>>>> but i don't know how to solve it. > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> can someone help me with this issue. > > >> >>>>>>>>>>>> > > >> >>>>>>>>>>>> Thanks, > > >> >>>>>>>>>>>> Yeshwanth > > >> >> > > >> > > > > > > > > >
