Quanlong Huang created IMPALA-12579:
---------------------------------------
Summary: Add logs for loading table list in catalogd startup
Key: IMPALA-12579
URL: https://issues.apache.org/jira/browse/IMPALA-12579
Project: IMPALA
Issue Type: Improvement
Components: Catalog
Reporter: Quanlong Huang
Assignee: Quanlong Huang
Catalogd loads the db, table and function list at startup. However, only the
progress of loading functions are logged:
{noformat}
I1127 21:52:49.292649 27403 CatalogServiceCatalog.java:1767] Loading native
functions for database: tpcds_seq_snap
I1127 21:52:49.292702 27403 CatalogServiceCatalog.java:1775] Loaded native
functions for database: tpcds_seq_snap
I1127 21:52:49.292730 27403 CatalogServiceCatalog.java:1790] Loading Java
functions for database: tpcds_seq_snap
I1127 21:52:49.292754 27403 CatalogServiceCatalog.java:1804] Loaded Java
functions for database: tpcds_seq_snap
I1127 21:52:49.297230 27403 CatalogServiceCatalog.java:1767] Loading native
functions for database: tpch
I1127 21:52:49.297310 27403 CatalogServiceCatalog.java:1775] Loaded native
functions for database: tpch
I1127 21:52:49.297349 27403 CatalogServiceCatalog.java:1790] Loading Java
functions for database: tpch
I1127 21:52:49.297379 27403 CatalogServiceCatalog.java:1804] Loaded Java
functions for database: tpch {noformat}
When a database contains a large number of tables, e.g. 100K, it could take
minutes to load its table list. We should add logs like "Loading table list for
database: db1" and "Loaded xxx tables for database: db1" to improve the
observability and supportability.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
