Noémi Pap-Takács created IMPALA-15061:
-----------------------------------------
Summary: Refactor and Improve IcebergFileMetadataLoader
Key: IMPALA-15061
URL: https://issues.apache.org/jira/browse/IMPALA-15061
Project: IMPALA
Issue Type: Improvement
Components: Catalog
Reporter: Noémi Pap-Takács
Assignee: Noémi Pap-Takács
IcebergFileMetadataLoader has changed a lot recently due to many optimizations
added over time. Now there are many different ways to (incrementally) reload a
table; reusing file descriptors or not, loading all content files/just the new
additions, etc.
It's time to do a refactor in file metadata loading to make the code more clear
and easy to understand. We can also add some optimizations/shortcuts once we
can identify the different scenarios where it is feasible.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
