Quanlong Huang created IMPALA-11534:
---------------------------------------
Summary: Skip reloading file metadata for some ALTER_TABLE events
Key: IMPALA-11534
URL: https://issues.apache.org/jira/browse/IMPALA-11534
Project: IMPALA
Issue Type: Improvement
Components: Catalog
Reporter: Quanlong Huang
EventProcessor will ignore trivial ALTER_TABLE events that only modify
tblproperties like "transient_lastDdlTime", "totalSize",
"numFilesErasureCoded", and "numFiles" (IMPALA-8579). For other kinds of
non-rename ALTER_TABLE events, it will trigger a full refresh on the table,
which is expensive when there are tens of thousands of partitions.
We can actually skip reloading file metadata for some ALTER_TABLE events, e.g.
events that
* changing table comment
* adding/dropping columns
* changing column definition (name/type/comment)
* changing ownership
* setting customized tblproperties
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
