[
https://issues.apache.org/jira/browse/IMPALA-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953085#comment-16953085
]
ASF subversion and git services commented on IMPALA-8797:
---------------------------------------------------------
Commit 6e32ca3617ba0d207b60850f0b78000f613d5f31 in impala's branch
refs/heads/master from Vihang Karajgaonkar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=6e32ca3 ]
IMPALA-9052: Events processor should skip blacklisted database and table
IMPALA-8797 introduced a configuration which can blacklist certain
database and tables so that catalog never loads them. This is useful to
skip the Hive's internal book-keeping tables which are unreadable by
Impala (like Information schema and sys tables). However, if there are
events generated on such tables, the events processor goes into error
state because the database does not exist.
This patch adds support for ignoring blacklisted database and tables in
the events processor.
Testing: 1. Added a new test case which makes sure that events processor
is not in error state after receiving events on blacklisted tables and
dbs.
2. Ran MetastoreEventsProcessorTest
Change-Id: Ic5a53b722e6225e9cad9954f447f821c2c677e60
Reviewed-on: http://gerrit.cloudera.org:8080/14457
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Blacklist "sys" and "information_schema" databases from Hive
> ------------------------------------------------------------
>
> Key: IMPALA-8797
> URL: https://issues.apache.org/jira/browse/IMPALA-8797
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog, Frontend
> Affects Versions: Impala 3.2.0
> Reporter: Bharath Vissapragada
> Assignee: Quanlong Huang
> Priority: Critical
> Fix For: Impala 3.4.0
>
>
> HMS exposes these two databases "sys" and "information_schema" which contain
> tables that expose the underlying meta information in a queryable format.
> However, Impala cannot read them because they come with custom serde that
> Impala doesn't support.
> From a usability point of view, we should black list those databases from
> loading, so that users don't see them when querying the database list. I
> think that is reasonable because they can't query them anyway.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
