[
https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-14310:
-----------------------------------------
Description:
Follow up for HIVE-14214 which completely shuts off PPD when there is any
schema evolution. Some evolutions are safer for PPD like
byte -> short -> int -> long
-float -> double- (This is unsafe, see comments in SchemaEvolution.java in the
patch)
varchar <-> string (string to char, varchar to char and vice versa is also
unsafe conversion as Orc stores internal index with padded spaces for char)
For all other conversions we can disable PPD for that specific column that has
evolved by returning TruthValue.YES_NO
was:
Follow up for HIVE-14214 which completely shuts off PPD when there is any
schema evolution. Some evolutions are safer for PPD like
byte -> short -> int -> long
-float -> double- This is unsafe, see comments in SchemaEvolution.java in the
patch
conversions between char, varchar and strings
For all other conversions we can disable PPD for that specific column that has
evolved by returning TruthValue.YES_NO
> ORC schema evolution should not completely disable PPD
> ------------------------------------------------------
>
> Key: HIVE-14310
> URL: https://issues.apache.org/jira/browse/HIVE-14310
> Project: Hive
> Issue Type: Bug
> Affects Versions: 2.2.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Priority: Critical
> Attachments: HIVE-14310.1.patch, HIVE-14310.WIP.patch
>
>
> Follow up for HIVE-14214 which completely shuts off PPD when there is any
> schema evolution. Some evolutions are safer for PPD like
> byte -> short -> int -> long
> -float -> double- (This is unsafe, see comments in SchemaEvolution.java in
> the patch)
> varchar <-> string (string to char, varchar to char and vice versa is also
> unsafe conversion as Orc stores internal index with padded spaces for char)
> For all other conversions we can disable PPD for that specific column that
> has evolved by returning TruthValue.YES_NO
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
