Gabor Kaszab created IMPALA-13296:
-------------------------------------

             Summary: Hive to Iceberg table-migration: pre-check column 
compatibility
                 Key: IMPALA-13296
                 URL: https://issues.apache.org/jira/browse/IMPALA-13296
             Project: IMPALA
          Issue Type: Bug
          Components: Frontend
            Reporter: Gabor Kaszab


The table migration from a Hive table to an Iceberg table is a multi-step 
process that has a middle step to rename the original table to a temp name. If 
a later step fails the user gets an error but the table remains renamed (the 
user also gets a hint how to set the original name back).

When the failure is column incompatibility (e.g. Iceberg doesn't support Hive's 
smallint, tinyint, varchar( n ) column types) we can do better because this 
imcompatibility could also be found during query analysis. That way the error 
could be sent before we rename the table. This results in a cleaner user 
experience.
{code:java}
Query: alter table hive_tbl convert to iceberg ERROR: IllegalArgumentException: 
Unsupported Hive type: VARCHAR, use string instead Your table might have been 
renamed. To reset the name try running: ALTER TABLE 
default.hive_tbl_tmp_8fb36dff RENAME TO default.hive_tbl;
{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to