[
https://issues.apache.org/jira/browse/IMPALA-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814188#comment-17814188
]
Quanlong Huang commented on IMPALA-12573:
-----------------------------------------
{quote}But if we invalidate some table manually ,we may want them to load .
{quote}
I think using REFRESH in this case is better.
However, we do need some more fine-grained config if we want some tables be
always loaded, e.g. some dimension tables. Maybe we can add two flags like
load_dbs_in_background and load_tables_in_background.
> Give configuration load_catalog_in_background more fine-grained configuration
> -----------------------------------------------------------------------------
>
> Key: IMPALA-12573
> URL: https://issues.apache.org/jira/browse/IMPALA-12573
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Maxwell Guo
> Assignee: Maxwell Guo
> Priority: Minor
>
> As we know if load_catalog_in_background set to true, then the table meta
> will load async for catalogd.
> During this period when catalogd starts up, if the flag set to true, then all
> the table will load async, then the queue will be big . So we may left it to
> false by deafult. But if we invalidate some table manually ,we may want them
> to load . So I think we can introduce a new flag
> load_catalog_in_background_at_startup , we can set
> load_catalog_in_background_at_startup to false, and
> load_catalog_in_background to true by default.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
