[
https://issues.apache.org/jira/browse/IMPALA-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717333#comment-17717333
]
ASF subversion and git services commented on IMPALA-11808:
----------------------------------------------------------
Commit f68986d4522aa2e581c4bbf464a0454f881d7553 in impala's branch
refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=f68986d45 ]
IMPALA-12082: Fix db not found error of INVALIDATE METADATA under unloaded db
INVALIDATE METADATA can be executed on tables under unloaded db. It will
bring up the metadata of the db by the way. However, this feature is
broken after IMPALA-11808 in which we try to get the table from catalog
cache assuming it's loaded. This causes the above use case failed by
DatabaseNotFoundException.
This patch fixes the regression by not getting the table from catalog
cache for INVALIDATE METADATA commands. We only do so for REFRESH
commands. After the INVALIDATE METADATA command succeeds, if we need to
fire reload events, we get the table from catalog cache.
Tests:
- Add e2e tests for event-processor is disabled and enabled.
Change-Id: Ifd0a9e87f06c38f569c32bd10cc2668403681fd4
Reviewed-on: http://gerrit.cloudera.org:8080/19786
Reviewed-by: Michael Smith <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Improve catalogD cache performance in a multi service environment for a
> refresh/invalidate query
> ------------------------------------------------------------------------------------------------
>
> Key: IMPALA-11808
> URL: https://issues.apache.org/jira/browse/IMPALA-11808
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Sai Hemanth Gantasala
> Assignee: Sai Hemanth Gantasala
> Priority: Major
>
> Improve catalogD cache performance in a multi-service environment for a
> refresh/invalidate query.
> This patch supports a new event called reload event in catalogD. This event
> is used to update table/file metadata for a refresh or invalidate command in
> other replicas of catalogDs when one of the replicas issues a
> refresh/invalidate command. HIVE-26838 is the Hive jira that adds support for
> this reload event. This feature is disabled by default using a config
> enable_reload_events. To use this feature set this config to true and impala
> will be able to fire reload events. The processing of reload events in the
> event processor is always enabled. There is an end-to-end test added for this
> feature which currently checks the firing/creation of the reload event and
> self-event check in the event processor. There is also an end-to-end test
> that tests this reload event in the event processor.
> There is also a follow-up jira
> [IMPALA-11822|http://issues.apache.org/jira/browse/IMPALA-11822] to track the
> optimization patch for this feature.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
