Yida Wu created IMPALA-13170:
--------------------------------
Summary: InconsistentMetadataFetchException due to database
dropped when showing databases
Key: IMPALA-13170
URL: https://issues.apache.org/jira/browse/IMPALA-13170
Project: IMPALA
Issue Type: Bug
Components: Catalog
Affects Versions: Impala 3.4.0
Reporter: Yida Wu
Assignee: Quanlong Huang
Using impalad 3.4.0, an InconsistentMetadataFetchException occurs when running
"show databases" in Impala while simultaneously executing "drop database" to
drop the newly created database in Hive.
Step is:
1, Creates database (Hive)
2, Creates tables (Hive)
3, Drops tables (Hive)
4, Run show databases (Impala) Drop database (Hive)
Logs in Impalad:
{code:java}
I0610 02:18:32.435815 278475 CatalogdMetaProvider.java:1354] 11111:22222]
Invalidated objects in cache: [list of database names, HMS_METADATA for DB
test_hive]
I0610 02:18:32.436224 278475 jni-util.cc:288] 11111:22222]
org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
DATABASE failed. Could not find TCatalogObject(type:DATABASE,
catalog_version:0, db:TDatabase(db_name:test_hive))
at
org.apache.impala.catalog.local.CatalogdMetaProvider.sendRequest(CatalogdMetaProvider.java:424)
at
org.apache.impala.catalog.local.CatalogdMetaProvider.access$100(CatalogdMetaProvider.java:185)
at
org.apache.impala.catalog.local.CatalogdMetaProvider$2.call(CatalogdMetaProvider.java:643)
at
org.apache.impala.catalog.local.CatalogdMetaProvider$2.call(CatalogdMetaProvider.java:638)
at
org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:521)
at
org.apache.impala.catalog.local.CatalogdMetaProvider.loadDb(CatalogdMetaProvider.java:635)
at org.apache.impala.catalog.local.LocalDb.getMetaStoreDb(LocalDb.java:91)
at org.apache.impala.catalog.local.LocalDb.getOwnerUser(LocalDb.java:294)
at org.apache.impala.service.Frontend.getDbs(Frontend.java:1066)
at org.apache.impala.service.JniFrontend.getDbs(JniFrontend.java:301)
I0610 02:18:32.436257 278475 status.cc:129] 11111:22222]
InconsistentMetadataFetchException: Fetching DATABASE failed. Could not find
TCatalogObject(type:DATABASE, catalog_version:0,
{code}
Logs in Catalog:
{code:java}
I0610 02:18:16.190133 222885 MetastoreEvents.java:505] EventId: 141467532
EventType: CREATE_DATABASE Successfully added database test_hive
...
I0610 02:18:32.276082 222885 MetastoreEvents.java:516] EventId: 141467562
EventType: DROP_DATABASE Creating event 141467562 of type DROP_DATABASE on
database test_hive
I0610 02:18:32.277876 222885 MetastoreEvents.java:254] Total number of events
received: 6 Total number of events filtered out: 0
I0610 02:18:32.277910 222885 MetastoreEvents.java:258] Incremented skipped
metric to 2564
I0610 02:18:32.279537 222885 MetastoreEvents.java:505] EventId: 141467562
EventType: DROP_DATABASE Removed Database test_hive
{code}
The case is similar to IMPALA-9441. We may want to handle the error in a better
way in Frontend.getDbs().
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
