Gabor Kaszab created IMPALA-11502:
-------------------------------------

             Summary: Dropping files of Iceberg table in HadoopCatalog will 
cause DROP TABLE to fail
                 Key: IMPALA-11502
                 URL: https://issues.apache.org/jira/browse/IMPALA-11502
             Project: IMPALA
          Issue Type: Bug
          Components: Frontend
    Affects Versions: Impala 4.1.0
            Reporter: Gabor Kaszab


When the files of n Iceberg table are dropped then a DROP TABLE will result in 
an error while the table will still show up in SHOW TABLES
Here are the steps to repro:

1) Run from Impala-shell
{code:java}
DROP DATABASE IF EXISTS `drop_incomplete_table` CASCADE;
CREATE DATABASE `drop_incomplete_table`;
CREATE TABLE drop_incomplete_table.iceberg_tbl (i int) stored as iceberg
    tblproperties('iceberg.catalog'='hadoop.catalog',
                                
'iceberg.catalog_location'='/test-warehouse/drop_incomplete_table');

INSERT INTO drop_incomplete_table.iceberg_tbl VALUES (1), (2), (3);
{code}

2) Drop the folder of the table with hdfs dfs
{code:java}
hdfs dfs -rm -r hdfs://localhost:20500/test-warehouse/drop_incomplete_table
{code}

3) Try to drop the table from Impala-shell
{code:java}
DROP TABLE drop_incomplete_table.iceberg_tbl;
{code}

This results in the following error:
{code:java}
ERROR: TableNotFoundException: Table 'drop_incomplete_table.iceberg_tbl' does 
not exist in Iceberg catalog.
{code}
While table is still there in show tables output even after an invalidate 
metadata.






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to