Hi Ray, Apologies for my very slow response.
Here is a draft of a doc which explains how I think we can tackle this: http://wiki.apache.org/hadoop/Hive/FilterPushdownDev Maybe you can work on translation from ExprNodeDesc -> HBase scan object? If you can get that working in isolation in unit tests, I can help with the rest of the parts for plumbing the filter through from Hive's optimizer. JVS On Jul 1, 2010, at 2:57 PM, Ray Duong wrote: Thanks John, Can you provide me with some pointers?. My team can try to work on it. Our workaround right now is to call the Thrift API from within Hive using a UDF. Thanks, -ray On Thu, Jul 1, 2010 at 1:19 PM, John Sichi <[email protected]<mailto:[email protected]>> wrote: On Jul 1, 2010, at 10:36 AM, Ray Duong wrote: > Is there away to do a hbase key lookup using the Hive-Hbase integration > without doing a full scan? > > Since I'm specifying the key='foo' in the where condition, shouldn't it be a > fast lookup? Hi Ray, Pushing down filters to HBase is one of our roadmap items. https://issues.apache.org/jira/browse/HIVE-1226 If you'd like to work on it, let me know and I'll give you some pointers. JVS
