[ 
https://issues.apache.org/jira/browse/DRILL-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kunal Khatua updated DRILL-4072:
--------------------------------
    Component/s: Storage - Avro

> Hive partition pruning not working with avro serde's
> ----------------------------------------------------
>
>                 Key: DRILL-4072
>                 URL: https://issues.apache.org/jira/browse/DRILL-4072
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Avro
>    Affects Versions: 1.3.0
>            Reporter: Rahul Challapalli
>            Priority: Major
>         Attachments: episodes.avro, hive.ddl
>
>
> git.commit.id.abbrev=e78e286
> The below plan indicates that partition pruning is not happening
> {code}
> explain plan for select * from hive.episodes_partitioned where doctor > 4;
> +------+------+
> | text | json |
> +------+------+
> | 00-00    Screen
> 00-01      Project(title=[$0], air_date=[$1], doctor=[$2], doctor_pt=[$3])
> 00-02        Project(title=[$0], air_date=[$1], doctor=[$2], doctor_pt=[$3])
> 00-03          SelectionVectorRemover
> 00-04            Filter(condition=[>($2, 4)])
> 00-05              Scan(groupscan=[HiveScan [table=Table(dbName:default, 
> tableName:episodes_partitioned), 
> inputSplits=[maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=1/000000_0:0+367,
>  
> maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=11/000000_0:0+393,
>  
> maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=2/000000_0:0+371,
>  
> maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=4/000000_0:0+368,
>  
> maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=5/000000_0:0+357,
>  
> maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=6/000000_0:0+370,
>  
> maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=9/000000_0:0+350],
>  columns=[`*`], numPartitions=7, partitions= [Partition(values:[1]), 
> Partition(values:[11]), Partition(values:[2]), Partition(values:[4]), 
> Partition(values:[5]), Partition(values:[6]), Partition(values:[9])]]])
> {code}
> I attached the data file and the hql required. Let me know if anything else 
> is needed



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to