[jira] [Updated] (HIVE-9149) Add unit test to test implicit conversion during dynamic partitioning/distribute by
[ https://issues.apache.org/jira/browse/HIVE-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-9149: - Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks for review Prasanth. Add unit test to test implicit conversion during dynamic partitioning/distribute by --- Key: HIVE-9149 URL: https://issues.apache.org/jira/browse/HIVE-9149 Project: Hive Issue Type: Bug Components: Tests Reporter: Jason Dere Assignee: Jason Dere Fix For: 0.15.0 Attachments: HIVE-9149.1.patch, HIVE-9149.2.patch This particular case was failing in Hive 0.13 because the string key column was not being converted to INT when written to the ORC file, resulting in a type cast error when reading data from the table. HIVE-8151 seems to have fixed this issue, but I would like to add a unit test to make sure we don't regress. {noformat} create table implicit_cast_during_insert (c1 int, c2 string) partitioned by (p1 string) stored as orc; set hive.exec.dynamic.partition.mode=nonstrict; insert overwrite table implicit_cast_during_insert partition (p1) select key, value, key key1 from (select * from src where key = 0) q distribute by key1 sort by key1; select * from implicit_cast_during_insert; drop table implicit_cast_during_insert; {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9149) Add unit test to test implicit conversion during dynamic partitioning/distribute by
[ https://issues.apache.org/jira/browse/HIVE-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-9149: - Status: Patch Available (was: Open) Add unit test to test implicit conversion during dynamic partitioning/distribute by --- Key: HIVE-9149 URL: https://issues.apache.org/jira/browse/HIVE-9149 Project: Hive Issue Type: Bug Components: Tests Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-9149.1.patch This particular case was failing in Hive 0.13 because the string key column was not being converted to INT when written to the ORC file, resulting in a type cast error when reading data from the table. HIVE-8151 seems to have fixed this issue, but I would like to add a unit test to make sure we don't regress. {noformat} create table implicit_cast_during_insert (c1 int, c2 string) partitioned by (p1 string) stored as orc; set hive.exec.dynamic.partition.mode=nonstrict; insert overwrite table implicit_cast_during_insert partition (p1) select key, value, key key1 from (select * from src where key = 0) q distribute by key1 sort by key1; select * from implicit_cast_during_insert; drop table implicit_cast_during_insert; {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9149) Add unit test to test implicit conversion during dynamic partitioning/distribute by
[ https://issues.apache.org/jira/browse/HIVE-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-9149: - Attachment: HIVE-9149.1.patch Add unit test to test implicit conversion during dynamic partitioning/distribute by --- Key: HIVE-9149 URL: https://issues.apache.org/jira/browse/HIVE-9149 Project: Hive Issue Type: Bug Components: Tests Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-9149.1.patch This particular case was failing in Hive 0.13 because the string key column was not being converted to INT when written to the ORC file, resulting in a type cast error when reading data from the table. HIVE-8151 seems to have fixed this issue, but I would like to add a unit test to make sure we don't regress. {noformat} create table implicit_cast_during_insert (c1 int, c2 string) partitioned by (p1 string) stored as orc; set hive.exec.dynamic.partition.mode=nonstrict; insert overwrite table implicit_cast_during_insert partition (p1) select key, value, key key1 from (select * from src where key = 0) q distribute by key1 sort by key1; select * from implicit_cast_during_insert; drop table implicit_cast_during_insert; {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-9149) Add unit test to test implicit conversion during dynamic partitioning/distribute by
[ https://issues.apache.org/jira/browse/HIVE-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-9149: - Attachment: HIVE-9149.2.patch Good point - in fact UDFToInteger was not being called because a constant 0 was being used in place of key due to optimization from (where key = 0). I've changed the query slightly and added the explain. Add unit test to test implicit conversion during dynamic partitioning/distribute by --- Key: HIVE-9149 URL: https://issues.apache.org/jira/browse/HIVE-9149 Project: Hive Issue Type: Bug Components: Tests Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-9149.1.patch, HIVE-9149.2.patch This particular case was failing in Hive 0.13 because the string key column was not being converted to INT when written to the ORC file, resulting in a type cast error when reading data from the table. HIVE-8151 seems to have fixed this issue, but I would like to add a unit test to make sure we don't regress. {noformat} create table implicit_cast_during_insert (c1 int, c2 string) partitioned by (p1 string) stored as orc; set hive.exec.dynamic.partition.mode=nonstrict; insert overwrite table implicit_cast_during_insert partition (p1) select key, value, key key1 from (select * from src where key = 0) q distribute by key1 sort by key1; select * from implicit_cast_during_insert; drop table implicit_cast_during_insert; {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)