[
https://issues.apache.org/jira/browse/IMPALA-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18021439#comment-18021439
]
ASF subversion and git services commented on IMPALA-14016:
----------------------------------------------------------
Commit b0f1d4904289869af445ec7171b3af4126d634ca in impala's branch
refs/heads/master from Peter Rozsa
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=b0f1d4904 ]
IMPALA-14016: Add multi-catalog support for local catalog mode
This patch adds a new MetaProvider called MultiMetaProvider, which is
capable of handling multiple MetaProviders at once, prioritizing one
primary provider over multiple secondary providers. The primary
provider handles some methods exclusively for deterministic behavior.
In database listings, if one database name occurs multiple times the
contained tables are merged under that database name; if the two
separate databases contain a table with the same name, the query
analyzation fails with an error.
This change also modifies the local catalog implementation's
initialization. If catalogd is deployed, then it instantiates the
CatalogdMetaProvider and checks if the catalog configuration directory
is set as a backend flag. If it's set, then it tries to load every
configuration from the folder, and tries to instantiate the
IcebergMetaProvider from those configs. If the instantiation fails, an
error is reported to the logs, but the startup is not interrupted.
Tests:
- E2E tests for multi-catalog behavior
- Unit test for ConfigLoader
Change-Id: Ifbdd0f7085345e7954d9f6f264202699182dd1e1
Reviewed-on: http://gerrit.cloudera.org:8080/22878
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Reviewed-by: Zoltan Borok-Nagy <borokna...@cloudera.com>
> Add multi-catalog support
> -------------------------
>
> Key: IMPALA-14016
> URL: https://issues.apache.org/jira/browse/IMPALA-14016
> Project: IMPALA
> Issue Type: Task
> Reporter: Peter Rozsa
> Assignee: Peter Rozsa
> Priority: Major
>
> Impala supports only one catalog at once. To make the usage of external
> catalogs (eg.: Iceberg REST catalog), Impala should support connecting to
> multiple catalogs simultaneously. This effort covers the case when the
> addition catalog's content is represented at the same level as the primary
> catalog's content, there's no distinction at the catalog level.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
