Yes testing custom filters in HBase are sort of pain. On Thu, Jun 28, 2012 at 5:53 AM, Evan Pollan <[email protected]> wrote:
> Thanks Amandeep -- I hadn't seen the FilterList. That should be able to > get me most of the way there by simply "indexing" and chaining together > DependentColumnFilters. > > I think I'm going to try to avoid reconfiguring the cluster and restarting > the region servers at all costs. > > > > On Wed, Jun 27, 2012 at 12:54 PM, Amandeep Khurana <[email protected]> > wrote: > > > Currently, you have to compile a jar, put them on all servers and restart > > the RS process. I don't believe there is an easier way to do it as of > right > > now. And I agree, it's not entirely desirable to have to restart the > > cluster to install a custom filter. > > > > You can combine multiple filters into a FilterList and configure it in > two > > modes: Pass All, or Pass One. Did you try that? > > > > Example: > > List<Filter> myList = new ArrayList(); > > myList.add(myTimestampFilter); > > myList.add(myRowFilter); > > FilterList myFilterList = new > > FilterList(FilterList.Operator.MUST_PASS_ALL, myList); > > myFilterList.addFilter(myQualiFilter); > > > > > > On Wednesday, June 27, 2012 at 1:47 PM, Evan Pollan wrote: > > > > > What're the current best practices for making custom Filter > > implementation > > > classes available to the region servers? My cluster is running 0.90.4 > > from > > > the CDH3U3 distribution, FWIW. > > > > > > I searched around and didn't find anything other than "add your filter > to > > > the region server's classpath." I'm hoping there's support for > something > > > that doesn't involve actually installing jar files on each region > server, > > > updating each region server's configuration, and doing a rolling > restart > > of > > > the whole cluster... > > > > > > I did find this still-outstanding bug requesting parity between > > HDFS-based > > > co-processor class loading and filter class loading: > > > https://issues.apache.org/jira/browse/HBASE-1936. > > > > > > How are folks handling this? > > > > > > The stock filters are fairly limited, especially without the ability > (at > > > least AFAIK) to combine the existing filters together via basic boolean > > > algebra, so I can't do much without writing my own filter(s). > > > > > > > > > thanks, > > > Evan > > > > > > > > > -- *Benjamin Kim* *benkimkimben at gmail*
