Zoltán Borók-Nagy created IMPALA-15510:
------------------------------------------
Summary: Avoid calling initial planFiles() when Iceberg REST
Catalog is being used
Key: IMPALA-15510
URL: https://issues.apache.org/jira/browse/IMPALA-15510
Project: IMPALA
Issue Type: Improvement
Components: Frontend
Reporter: Zoltán Borók-Nagy
Currently Impala always issues a planFiles() Iceberg API call when it loads a
table. It can be useful for caching, especially on HDFS, but quite unnecessary
on object stores.
The Impala REST Client doesn't even cache the loaded table objects, i.e. the
initial planFiles() by IcebergMetaProvider is completely wasteful.
We should avoid calling planFiles() (at least in IcebergMetaProvider), in which
case only the IcebergScanPlanner would call it with all the query predicates.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
