[
https://issues.apache.org/jira/browse/IMPALA-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691547#comment-16691547
]
ASF subversion and git services commented on IMPALA-7824:
---------------------------------------------------------
Commit 59f3f6b901581d2f6b5084fa739db2b5870f2af0 in impala's branch
refs/heads/branch-3.1.0 from [~fredyw]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=59f3f6b ]
IMPALA-7824: INVALIDATE METADATA should not hang when Sentry is unavailable
Before this patch, running INVALIDATE METADATA when Sentry is
unavailable could cause Impala query to hang. PolicyReader thread in
SentryProxy is used by two use cases, one as a background thread
that periodically refreshes Sentry policy and another one as a
synchronous operation for INVALIDATE METADATA. For the background
thread, we need to swallow any exception thrown while refreshing the
Sentry policy in order to not kill the background thread. For a
synchronous reset operation, such as INVALIDATE METADATA, swallowing
an exception causes the Impala catalog to wait indefinitely for
authorization catalog objects that never get processed due to Sentry
being unavailable. The patch updates the code by not swallowing any
exception in INVALIDATE METADATA and return the exception to the
caller.
Testing:
- Ran all FE tests
- Added a new E2E test
- Ran all E2E authorization tests
Change-Id: Icff987a6184f62a338faadfdc1a0d349d912fc37
Reviewed-on: http://gerrit.cloudera.org:8080/11897
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Running INVALIDATE METADATA with authorization enabled can cause a hang if
> Sentry is unavailable
> ------------------------------------------------------------------------------------------------
>
> Key: IMPALA-7824
> URL: https://issues.apache.org/jira/browse/IMPALA-7824
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Affects Versions: Impala 3.0, Impala 2.12.0
> Reporter: Fredy Wijaya
> Assignee: Fredy Wijaya
> Priority: Critical
> Fix For: Impala 3.1.0
>
>
> Steps to reproduce:
> 1. Start Impala with authorization
> 2. Kill Sentry
> 3. Run INVALIDATE METADATA
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
