[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Resolution: Fixed Fix Version/s: 2.1.1 2.2.0 Status: Resolved (was: Patch Available) Patch committed to master and branch-2.1 > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.1.0, 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Fix For: 2.2.0, 2.1.1 > > Attachments: HIVE-14310.1.patch, HIVE-14310.2.patch, > HIVE-14310.4.patch, HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > -float -> double- (This is unsafe, see comments in SchemaEvolution.java in > the patch) > varchar <-> string (string to char, varchar to char and vice versa is also > unsafe conversion as Orc stores internal index with padded spaces for char) > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Affects Version/s: 2.1.0 > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.1.0, 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Attachments: HIVE-14310.1.patch, HIVE-14310.2.patch, > HIVE-14310.4.patch, HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > -float -> double- (This is unsafe, see comments in SchemaEvolution.java in > the patch) > varchar <-> string (string to char, varchar to char and vice versa is also > unsafe conversion as Orc stores internal index with padded spaces for char) > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Target Version/s: 2.1.0, 2.2.0 (was: 2.2.0) > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.1.0, 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Attachments: HIVE-14310.1.patch, HIVE-14310.2.patch, > HIVE-14310.4.patch, HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > -float -> double- (This is unsafe, see comments in SchemaEvolution.java in > the patch) > varchar <-> string (string to char, varchar to char and vice versa is also > unsafe conversion as Orc stores internal index with padded spaces for char) > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Attachment: HIVE-14310.4.patch Addressed [~owen.omalley]'s review comments. > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Attachments: HIVE-14310.1.patch, HIVE-14310.2.patch, > HIVE-14310.4.patch, HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > -float -> double- (This is unsafe, see comments in SchemaEvolution.java in > the patch) > varchar <-> string (string to char, varchar to char and vice versa is also > unsafe conversion as Orc stores internal index with padded spaces for char) > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Attachment: HIVE-14310.2.patch > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Attachments: HIVE-14310.1.patch, HIVE-14310.2.patch, > HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > -float -> double- (This is unsafe, see comments in SchemaEvolution.java in > the patch) > varchar <-> string (string to char, varchar to char and vice versa is also > unsafe conversion as Orc stores internal index with padded spaces for char) > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Description: Follow up for HIVE-14214 which completely shuts off PPD when there is any schema evolution. Some evolutions are safer for PPD like byte -> short -> int -> long -float -> double- (This is unsafe, see comments in SchemaEvolution.java in the patch) varchar <-> string (string to char, varchar to char and vice versa is also unsafe conversion as Orc stores internal index with padded spaces for char) For all other conversions we can disable PPD for that specific column that has evolved by returning TruthValue.YES_NO was: Follow up for HIVE-14214 which completely shuts off PPD when there is any schema evolution. Some evolutions are safer for PPD like byte -> short -> int -> long -float -> double- This is unsafe, see comments in SchemaEvolution.java in the patch conversions between char, varchar and strings For all other conversions we can disable PPD for that specific column that has evolved by returning TruthValue.YES_NO > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Attachments: HIVE-14310.1.patch, HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > -float -> double- (This is unsafe, see comments in SchemaEvolution.java in > the patch) > varchar <-> string (string to char, varchar to char and vice versa is also > unsafe conversion as Orc stores internal index with padded spaces for char) > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Description: Follow up for HIVE-14214 which completely shuts off PPD when there is any schema evolution. Some evolutions are safer for PPD like byte -> short -> int -> long -float -> double- This is unsafe, see comments in SchemaEvolution.java in the patch conversions between char, varchar and strings For all other conversions we can disable PPD for that specific column that has evolved by returning TruthValue.YES_NO was: Follow up for HIVE-14214 which completely shuts off PPD when there is any schema evolution. Some evolutions are safer for PPD like byte -> short -> int -> long float -> double conversions between char, varchar and strings For all other conversions we can disable PPD for that specific column that has evolved by returning TruthValue.YES_NO > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Attachments: HIVE-14310.1.patch, HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > -float -> double- This is unsafe, see comments in SchemaEvolution.java in the > patch > conversions between char, varchar and strings > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Status: Patch Available (was: Open) > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Attachments: HIVE-14310.1.patch, HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > float -> double > conversions between char, varchar and strings > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Attachment: HIVE-14310.1.patch Patch generated on top of HIVE-14333. With that all the test cases work fine. > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Attachments: HIVE-14310.1.patch, HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > float -> double > conversions between char, varchar and strings > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-14310) ORC schema evolution should not completely disable PPD
[ https://issues.apache.org/jira/browse/HIVE-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14310: - Attachment: HIVE-14310.WIP.patch > ORC schema evolution should not completely disable PPD > -- > > Key: HIVE-14310 > URL: https://issues.apache.org/jira/browse/HIVE-14310 > Project: Hive > Issue Type: Bug >Affects Versions: 2.2.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Critical > Attachments: HIVE-14310.WIP.patch > > > Follow up for HIVE-14214 which completely shuts off PPD when there is any > schema evolution. Some evolutions are safer for PPD like > byte -> short -> int -> long > float -> double > conversions between char, varchar and strings > For all other conversions we can disable PPD for that specific column that > has evolved by returning TruthValue.YES_NO -- This message was sent by Atlassian JIRA (v6.3.4#6332)
