[
https://issues.apache.org/jira/browse/IMPALA-15061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on IMPALA-15061 started by Noémi Pap-Takács.
-------------------------------------------------
> Refactor and Improve IcebergFileMetadataLoader
> ----------------------------------------------
>
> Key: IMPALA-15061
> URL: https://issues.apache.org/jira/browse/IMPALA-15061
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Noémi Pap-Takács
> Assignee: Noémi Pap-Takács
> Priority: Major
> Labels: impala-iceberg
>
> IcebergFileMetadataLoader has changed a lot recently due to many
> optimizations added over time. Now there are many different ways to
> (incrementally) reload a table; reusing file descriptors or not, loading all
> content files/just the new additions, etc.
> It's time to do a refactor in file metadata loading to make the code more
> clear and easy to understand. We can also add some optimizations/shortcuts
> once we can identify the different scenarios where it is feasible.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
