[
https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935951#comment-14935951
]
Swarnim Kulkarni commented on HIVE-11609:
-----------------------------------------
[~ashutoshc] So I looked into this a little bit and looks like the fix with
HIVE-10940 isn't really going to work, mostly because it seems to be pretty
tailored to Tez. The SerializeFilter is only called for TezCompiler[1]. Any
reason why this is not called for MapreduceCompiler too or SparkCompiler? As a
quick hack, I tried calling it within the MapReduceCompiler in the
"optimizeTaskPlan" but that doesn't seem to work very well too. Might need to
dig a little bit into what's going on there. If it's ok with you, I would
potentially like to log a separate bug though and tackle it there just to keep
it separate from what we are trying to do here. If that works, we can re-add
the "transient" and only go the SerializeFilter route.
[1]
https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/parse/TezCompiler.java#L486-L490
> Capability to add a filter to hbase scan via composite key doesn't work
> -----------------------------------------------------------------------
>
> Key: HIVE-11609
> URL: https://issues.apache.org/jira/browse/HIVE-11609
> Project: Hive
> Issue Type: Bug
> Components: HBase Handler
> Reporter: Swarnim Kulkarni
> Assignee: Swarnim Kulkarni
> Attachments: HIVE-11609.1.patch.txt, HIVE-11609.2.patch.txt
>
>
> It seems like the capability to add filter to an hbase scan which was added
> as part of HIVE-6411 doesn't work. This is primarily because in the
> HiveHBaseInputFormat, the filter is added in the getsplits instead of
> getrecordreader. This works fine for start and stop keys but not for filter
> because a filter is respected only when an actual scan is performed. This is
> also related to the initial refactoring that was done as part of HIVE-3420.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
