Mona Chitnis created PIG-3594:
---------------------------------
Summary: Pig with HCatLoader scans all partitions
Key: PIG-3594
URL: https://issues.apache.org/jira/browse/PIG-3594
Project: Pig
Issue Type: Bug
Affects Versions: 0.11.1
Reporter: Mona Chitnis
Fix For: 0.11.2
When running the following pig query (script.pig) :
A = LOAD ' my_data' USING org.apache.hcatalog.pig.HCatLoader();
B = FILTER A by part1=='$val1' and part2 matches '$val2';
C = FILTER B by map#'key' matches '(val3|val4)';
DUMP C;
> pig -useHCatalog -p val1=2013_01_01 val2=XYZ script.pig
This results in Pig scanning all partitions inspite of filter condition.
part1=='$val1' should have been pushed to HCatLoader even though there are
other conditions that cannot be pushed.
--
This message was sent by Atlassian JIRA
(v6.1#6144)