Vihang Karajgaonkar created IMPALA-9698:
-------------------------------------------
Summary: Filemetadata loader should avoid recursing into out of
range writeId directories
Key: IMPALA-9698
URL: https://issues.apache.org/jira/browse/IMPALA-9698
Project: IMPALA
Issue Type: Improvement
Reporter: Vihang Karajgaonkar
Assignee: Vihang Karajgaonkar
Currently by default the FileMetadataLoader in Catalogd recurses into partition
directories to load the file metadata. However, in case of transactional
tables, many of such directories could be out of scope for the ValidWriteList
of that table when the load is happening. Avoiding to recurse in such
directories could help speed up the file-metadata load on transactional tables
when compaction is not being run for longer durations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
