Zoltán Borók-Nagy created IMPALA-11022:
------------------------------------------
Summary: Impala uses wrong file descriptors for Iceberg tables in
local catalog mode
Key: IMPALA-11022
URL: https://issues.apache.org/jira/browse/IMPALA-11022
Project: IMPALA
Issue Type: Bug
Reporter: Zoltán Borók-Nagy
When local catalog mode is used, Impala retrieves the Iceberg snapshot from
CatalogD. The response contains a map of the file descriptors.
https://github.com/apache/impala/blob/b692a92fa2a2277a185fb5823592609b4603c0d8/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java#L1006
The file descriptors contain block location information, but the hosts are only
referred by indexes.
https://github.com/apache/impala/blob/b692a92fa2a2277a185fb5823592609b4603c0d8/common/fbs/CatalogObjects.fbs#L50
In the Coordinator's local catalog the host indexes might refer to different
hosts than in CatalogD. We should translate the host indexes to the
coordinators host list. Similarly to the LocalFsTable:
https://github.com/apache/impala/blob/b692a92fa2a2277a185fb5823592609b4603c0d8/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java#L983
https://github.com/apache/impala/blob/b692a92fa2a2277a185fb5823592609b4603c0d8/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java#L1020-L1024
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
