[
https://issues.apache.org/jira/browse/PIG-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohini Palaniswamy updated PIG-3172:
------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed to trunk (0.12). Thanks Daniel.
> Partition filter push down does not happen when there is a non partition key
> map column filter
> ----------------------------------------------------------------------------------------------
>
> Key: PIG-3172
> URL: https://issues.apache.org/jira/browse/PIG-3172
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.1
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3172-1.patch
>
>
> A = LOAD 'job_confs' USING org.apache.hcatalog.pig.HCatLoader();
> B = FILTER A by grid == 'cluster1' and dt < '2012_12_01' and dt >
> '2012_11_20';
> C = FILTER B by params#'mapreduce.job.user.name' == 'userx';
> D = FOREACH B generate dt, grid, params#'mapreduce.job.user.name' as user,
> params#'mapreduce.job.name' as job_name, job_id,
> params#'mapreduce.job.cache.files';
> dump D;
> The query gives the below warning and ends up scanning the whole table
> instead of pushing the partition key filters grid and dt.
> [main] WARN org.apache.pig.newplan.PColFilterExtractor - No partition filter
> push down: Internal error while processing any partition filter conditions in
> the filter after the load
> Works fine if the second filter is on a column with simple datatype like
> chararray instead of map.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
