[ 
https://issues.apache.org/jira/browse/IMPALA-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tim Armstrong updated IMPALA-9698:
----------------------------------
    Component/s: Catalog

> Filemetadata loader should avoid recursing into out of range writeId 
> directories
> --------------------------------------------------------------------------------
>
>                 Key: IMPALA-9698
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9698
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Catalog
>            Reporter: Vihang Karajgaonkar
>            Assignee: Vihang Karajgaonkar
>            Priority: Major
>
> Currently by default the FileMetadataLoader in Catalogd recurses into 
> partition directories to load the file metadata. However, in case of 
> transactional tables, many of such directories could be out of scope for the 
> ValidWriteList of that table when the load is happening. Avoiding to recurse 
> in such directories could help speed up the file-metadata load on 
> transactional tables when compaction is not being run for longer durations.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to