Gabor Kaszab created IMPALA-11503:
-------------------------------------
Summary: Dropping files of Iceberg table in HiveCatalog will cause
DROP TABLE to fail
Key: IMPALA-11503
URL: https://issues.apache.org/jira/browse/IMPALA-11503
Project: IMPALA
Issue Type: Bug
Components: Frontend
Affects Versions: Impala 4.1.0
Reporter: Gabor Kaszab
When the files of n Iceberg table are dropped then a DROP TABLE will result in
an error while the table will still show up in SHOW TABLES
Here are the steps to repro:
1) Run from Impala-shell
{code:java}
DROP DATABASE IF EXISTS `drop_incomplete_table` CASCADE;
CREATE DATABASE `drop_incomplete_table`;
CREATE TABLE drop_incomplete_table.iceberg_tbl (i int) stored as iceberg
tblproperties('iceberg.catalog'='hadoop.catalog',
'iceberg.catalog_location'='/test-warehouse/drop_incomplete_table');
INSERT INTO drop_incomplete_table.iceberg_tbl VALUES (1), (2), (3);
{code}
2) Drop the folder of the table with hdfs dfs
{code:java}
hdfs dfs -rm -r hdfs://localhost:20500/test-warehouse/drop_incomplete_table
{code}
3) Try to drop the table from Impala-shell
{code:java}
DROP TABLE drop_incomplete_table.iceberg_tbl;
{code}
This results in the following error:
{code:java}
ERROR: TableNotFoundException: Table 'drop_incomplete_table.iceberg_tbl' does
not exist in Iceberg catalog.
{code}
While table is still there in show tables output even after an invalidate
metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)