Rahul Challapalli created DRILL-4072:
----------------------------------------
Summary: Hive partition pruning not working with avro serde's
Key: DRILL-4072
URL: https://issues.apache.org/jira/browse/DRILL-4072
Project: Apache Drill
Issue Type: Bug
Affects Versions: 1.3.0
Reporter: Rahul Challapalli
git.commit.id.abbrev=e78e286
The below plan indicates that partition pruning is not happening
{code}
explain plan for select * from hive.episodes_partitioned where doctor > 4;
+------+------+
| text | json |
+------+------+
| 00-00 Screen
00-01 Project(title=[$0], air_date=[$1], doctor=[$2], doctor_pt=[$3])
00-02 Project(title=[$0], air_date=[$1], doctor=[$2], doctor_pt=[$3])
00-03 SelectionVectorRemover
00-04 Filter(condition=[>($2, 4)])
00-05 Scan(groupscan=[HiveScan [table=Table(dbName:default,
tableName:episodes_partitioned),
inputSplits=[maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=1/000000_0:0+367,
maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=11/000000_0:0+393,
maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=2/000000_0:0+371,
maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=4/000000_0:0+368,
maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=5/000000_0:0+357,
maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=6/000000_0:0+370,
maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=9/000000_0:0+350],
columns=[`*`], numPartitions=7, partitions= [Partition(values:[1]),
Partition(values:[11]), Partition(values:[2]), Partition(values:[4]),
Partition(values:[5]), Partition(values:[6]), Partition(values:[9])]]])
{code}
I attached the data file and the hql required. Let me know if anything else is
needed
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
