[ https://issues.apache.org/jira/browse/HIVE-26507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajesh Balamohan updated HIVE-26507: ------------------------------------ Labels: iceberg (was: ) > Iceberg: In place metadata generation may not work for certain datatypes > ------------------------------------------------------------------------ > > Key: HIVE-26507 > URL: https://issues.apache.org/jira/browse/HIVE-26507 > Project: Hive > Issue Type: Bug > Reporter: Rajesh Balamohan > Priority: Major > Labels: iceberg > > "alter table" statements can be used for generating iceberg metadata > information (i.e for converting external tables -> iceberg tables). > As part of this process, it also converts certain datatypes to iceberg > compatible types (e.g char -> string). "iceberg.mr.schema.auto.conversion" > enables this conversion. > This could cause certain issues at runtime. Here is an example > {noformat} > Before conversion: > ================== > -- external table > select count(*) from customer_demographics where cd_gender = 'F' and > cd_marital_status = 'U' and cd_education_status = '2 yr Degree'; > 27440 > after conversion: > ================= > -- iceberg table > select count(*) from customer_demographics where cd_gender = 'F' and > cd_marital_status = 'U' and cd_education_status = '2 yr Degree'; > 0 > select count(*) from customer_demographics where cd_gender = 'F' and > cd_marital_status = 'U' and trim(cd_education_status) = '2 yr Degree'; > 27440 > {noformat} > -- This message was sent by Atlassian Jira (v8.20.10#820010)