[
https://issues.apache.org/jira/browse/IMPALA-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sai Hemanth Gantasala reassigned IMPALA-11534:
----------------------------------------------
Assignee: Sai Hemanth Gantasala
> Skip reloading file metadata for some ALTER_TABLE events
> --------------------------------------------------------
>
> Key: IMPALA-11534
> URL: https://issues.apache.org/jira/browse/IMPALA-11534
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Quanlong Huang
> Assignee: Sai Hemanth Gantasala
> Priority: Critical
>
> EventProcessor will ignore trivial ALTER_TABLE events that only modify
> tblproperties like "transient_lastDdlTime", "totalSize",
> "numFilesErasureCoded", and "numFiles" (IMPALA-8579). For other kinds of
> non-rename ALTER_TABLE events, it will trigger a full refresh on the table,
> which is expensive when there are tens of thousands of partitions.
> We can actually skip reloading file metadata for some ALTER_TABLE events,
> e.g. events that
> * changing table comment
> * adding/dropping columns
> * changing column definition (name/type/comment)
> * changing ownership
> * setting customized tblproperties
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
