Yida Wu created IMPALA-14818:
--------------------------------
Summary: Skip stale events before catch-up mode to prevent
redundant table invalidation
Key: IMPALA-14818
URL: https://issues.apache.org/jira/browse/IMPALA-14818
Project: IMPALA
Issue Type: Task
Components: Catalog
Reporter: Yida Wu
Currently, catalog catch-up mode can repeatedly invalidate frequently queried
tables because it evaluates event lag before checking if the table's metadata
is already newer than the delayed event. We may optimize the event processor by
checking the table's createEventId and lastRefreshEventId to safely skip these
stale events before the catch-up mode triggers, this logic is in the
isOlderEvent() in some places but behind the handleIfInCatchUpMode(), we should
evaluate whether this logic can be refactored so that these cheap checks happen
earlier, while ensuring correctness and avoiding regressions
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
