What's the value for hbase.dynamic.jars.dir ? Cheers
> On Apr 20, 2015, at 12:53 AM, Jeetendra Gangele <[email protected]> wrote: > > I have put my jar in sub folder of hbase.rootdir still not working > I am getting same error class not found. > >> On 18 April 2015 at 03:54, Ted Yu <[email protected]> wrote: >> >> bq. This will @ hbase-site.xml? >> >> Yes. >> >> bq. can I pur my jar containing SuffixFilter class into hbase.rootdir? >> >> Better create a sub-folder under the rootdir. >> >> On Fri, Apr 17, 2015 at 1:58 PM, Jeetendra Gangele <[email protected]> >> wrote: >> >>> This will @ hbase-site.xml? >>> >>> can I pur my jar containing SuffixFilter class into hbase.rootdir? >>> >>>> On 18 April 2015 at 02:19, Ted Yu <[email protected]> wrote: >>>> >>>> bq. Hbase 0.98.4 so this feature already should be there? >>>> >>>> Yes. >>>> >>>> Drop the class containing SuffixFilter class in location specified by >>>> hbase.dynamic.jars.dir >>>> config. Then region server should be able to find it. >>>> >>>> On Fri, Apr 17, 2015 at 10:22 AM, Jeetendra Gangele < >>> [email protected]> >>>> wrote: >>>> >>>>> I am using Hbase 0.98.4 so this feature already should be there? >>>>> problem is FilterList class(when we add this filter) not able to find >>> the >>>>> SuffixFilter >>>>> >>>>>> On 17 April 2015 at 22:47, Jeetendra Gangele <[email protected]> >>>>> wrote: >>>>> >>>>>> Yes I used inside my project. This project will build the jar that >>> jar >>>> I >>>>>> added with classpath when running the job >>>>>> >>>>>>> On 17 April 2015 at 22:40, Ted Yu <[email protected]> wrote: >>>>>>> >>>>>>> bq. java.io.IOException: java.lang.ClassNotFoundException: >>>>>>> com.insideview.yam.HbaseClient.SuffixFilter >>>>>>> >>>>>>> I assume you copied SuffixFilter class to your insideview project. >>> How >>>>> did >>>>>>> you deploy the jar containing SuffixFilter to hbase cluster ? >>>>>>> See HBASE-1936 for more details where hbase.dynamic.jars.dir was >>>>>>> introduced. >>>>>>> >>>>>>> Cheers >>>>>>> >>>>>>> On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele < >>>>> [email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> at java.lang.Thread.run(Thread.java:745) >>>>>>>> Caused by: java.lang.reflect.InvocationTargetException >>>>>>>> at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown >>>>> Source) >>>>>>>> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>>>>> at >> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439) >>>>>>>> ... 8 more >>>>>>>> Caused by: >>>>> org.apache.hadoop.hbase.exceptions.DeserializationException: >>>>>>>> java.io.IOException: java.lang.ClassNotFoundException: >>>>>>>> com.insideview.yam.HbaseClient.SuffixFilter >>>>>>>> at >>> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406) >>>>>>>> ... 12 more >>>>>>>> Caused by: java.io.IOException: >> java.lang.ClassNotFoundException: >>>>>>>> com.insideview.yam.HbaseClient.SuffixFilter >>>>>>>> at >> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441) >>>>>>>> at >>> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403) >>>>>>>> >>>>>>>> This is the error i m getting >>>>>>>>> On 17 April 2015 at 20:32, Ted Yu <[email protected]> wrote: >>>>>>>>> >>>>>>>>> Here is an example >>>>>>>>> from >> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java >>>>>>>>> : >>>>>>>>> >>>>>>>>> byte[] suffix = >>>>>>>>> ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY, >>>>>>>>> SchemaUtil.getTableNameAsBytes(schemaName, tableName)); >>>>>>>>> SuffixFilter rowFilter = new SuffixFilter(suffix); >>>>>>>>> Filter filter = new FilterList(linkFilter, rowFilter); >>>>>>>>> >>>>>>>>> You can use the following method from Bytes.java (in >>> hbase-common) >>>>> to >>>>>>>>> obtain byte[] from "12345" >>>>>>>>> >>>>>>>>> public static byte[] toBytes(String s) { >>>>>>>>> >>>>>>>>> Cheers >>>>>>>>> >>>>>>>>> On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele < >>>>>>> [email protected] >>>>>>>>> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> filterRowKey what is these arguments? Can you please explain >>>> lets >>>>>>> say I >>>>>>>>>> have data like abcde_12345 similary way >>>>>>>>>> and I want to scan all the records ending with "12345" what >>>>> should I >>>>>>>> pass >>>>>>>>>> to this function? >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On 16 April 2015 at 20:12, Ted Yu <[email protected]> >>> wrote: >>>>>>>>>> >>>>>>>>>>> Please take a look >>>>>>>>>>> at >> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java >>>>>>>>>>> in Phoenix repo. >>>>>>>>>>> >>>>>>>>>>> Processing is done in the following method: >>>>>>>>>>> >>>>>>>>>>> public boolean filterRowKey(byte[] buffer, int offset, >> int >>>>>>> length) >>>>>>>> { >>>>>>>>>>> >>>>>>>>>>> Note: the suffix is expressed in byte array. >>>>>>>>>>> >>>>>>>>>>> FYI >>>>>>>>>>> >>>>>>>>>>> On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele < >>>>>>>>> [email protected] >>>>>>>>>>> >>>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> Thanks for your reply.Ya I am filtering on row-key which >>>> ended >>>>>>> with >>>>>>>>>>> "12567" >>>>>>>>>>>> >>>>>>>>>>>> I did not understand properly what do you mean by "You >> can >>>>>>> compose >>>>>>>>>>>> SuffixFilter which filters row key by comparing suffix." >>>>>>>>>>>> >>>>>>>>>>>> can you elaborate . >>>>>>>>>>>> >>>>>>>>>>>> On 16 April 2015 at 19:49, Ted Yu <[email protected]> >>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> bq. record key ending with "12567" >>>>>>>>>>>>> >>>>>>>>>>>>> Can you clarify whether you're filtering by row key ? >>>>>>>>>>>>> If so, please take a look at PrefixFilter. >>>>>>>>>>>>> You can compose SuffixFilter which filters row key by >>>>>>> comparing >>>>>>>>>> suffix. >>>>>>>>>>>>> >>>>>>>>>>>>> Cheers >>>>>>>>>>>>> >>>>>>>>>>>>> On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele < >>>>>>>>>>> [email protected] >>>>>>>>>>>>> >>>>>>>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi All I have get all the records using scan with >> end >>>> with >>>>>>>>>> particular >>>>>>>>>>>>>> string let >>>>>>>>>>>>>> say record key ending with "12567". I need to scan >> and >>>> get >>>>>>> all >>>>>>>>> such >>>>>>>>>>>>> result. >>>>>>>>>>>>>> >>>>>>>>>>>>>> I am values filter and do the substring there but i >>> want >>>>> to >>>>>>>> avoid >>>>>>>>>>> this >>>>>>>>>>>>>> because its slow. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Regards >>>>>>>>>>>>>> jeetendra >>
