[
https://issues.apache.org/jira/browse/IMPALA-10152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17215274#comment-17215274
]
ASF subversion and git services commented on IMPALA-10152:
----------------------------------------------------------
Commit 05ad4ce05fca2f3bcd01946836c657c5479adca6 in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=05ad4ce ]
IMPALA-10152: part 1: refactor Iceberg catalog handling
This patch refactors the code a bit to make it easier in the future
to add support for new Iceberg catalogs. We plan to add support for
HiveCatalog in the near future.
Iceberg has two main interfaces to manage tables: Tables and Catalog.
I created a new interface in Impala called 'IcebergCatalog' that
abstracts both Tables and Catalog. Currently there are two
implementations for IcebergCatalog:
* HadoopTablesCatalog for HadoopTables
* HadoopCatalog for HadoopCatalog
This patch also delegates dropTable() to the Iceberg catalogs. Until
this patch we let HMS drop the tables and delete the directories. It
worked fine with the filesystem-based catalogs, but might not work well
with other Iceberg catalogs like HiveCatalog.
Change-Id: Ie69dff6cd6b8b3dc0ba5f7671b8504a936032a85
Reviewed-on: http://gerrit.cloudera.org:8080/16575
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Add support for Iceberg HiveCatalog
> -----------------------------------
>
> Key: IMPALA-10152
> URL: https://issues.apache.org/jira/browse/IMPALA-10152
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
>
> HadoopTables and HadoopCatalog only work on filesystems that support atomic
> rename. Therefore they are not safe on S3.
> HiveCatalog uses the Hive Metastore to keep track of Iceberg tables, so we
> should use this interface when we store our tables in object stores.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
