[ 
https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14722968#comment-14722968
 ] 

Swarnim Kulkarni commented on HIVE-11609:
-----------------------------------------

Some more info on my test environment:

1. My keys were salted which means no hot regions and even key distribution 
across regions.
2. No pre-splits when loading data. Though I feel the performance would have 
been even better if the regions were pre-split.
3. My CompositeKeyFactory implementation would take the successive 
predicates(key1="something" and key2="something2") and convert them to apt scan 
filter. So results on those types of queries completely depends on how you are 
handing the predicate to filter conversion logic inside your custom 
implementation. 

> Capability to add a filter to hbase scan via composite key doesn't work
> -----------------------------------------------------------------------
>
>                 Key: HIVE-11609
>                 URL: https://issues.apache.org/jira/browse/HIVE-11609
>             Project: Hive
>          Issue Type: Bug
>          Components: HBase Handler
>            Reporter: Swarnim Kulkarni
>            Assignee: Swarnim Kulkarni
>         Attachments: HIVE-11609.1.patch.txt, HIVE-11609.2.patch.txt
>
>
> It seems like the capability to add filter to an hbase scan which was added 
> as part of HIVE-6411 doesn't work. This is primarily because in the 
> HiveHBaseInputFormat, the filter is added in the getsplits instead of 
> getrecordreader. This works fine for start and stop keys but not for filter 
> because a filter is respected only when an actual scan is performed. This is 
> also related to the initial refactoring that was done as part of HIVE-3420.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to