[
https://issues.apache.org/jira/browse/IMPALA-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-9698:
----------------------------------
Component/s: Catalog
> Filemetadata loader should avoid recursing into out of range writeId
> directories
> --------------------------------------------------------------------------------
>
> Key: IMPALA-9698
> URL: https://issues.apache.org/jira/browse/IMPALA-9698
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Vihang Karajgaonkar
> Assignee: Vihang Karajgaonkar
> Priority: Major
>
> Currently by default the FileMetadataLoader in Catalogd recurses into
> partition directories to load the file metadata. However, in case of
> transactional tables, many of such directories could be out of scope for the
> ValidWriteList of that table when the load is happening. Avoiding to recurse
> in such directories could help speed up the file-metadata load on
> transactional tables when compaction is not being run for longer durations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]