[
https://issues.apache.org/jira/browse/HUDI-1164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Balaji Varadarajan updated HUDI-1164:
-------------------------------------
Description:
This ticket is to track all known locations where we call
FSUtils.getAllPartitionPaths
This should only impact the first time we do clean. Incremental cleaner should
reduce the scope of partition-paths to be listed. But again, consolidated
metadata would effectively avoid file-system level listing
was:
This ticket is to track all known locations where we call
FSUtils.getAllPartitionPaths
Consolidated Metadata would help avoid this listing.
> Audit Partition Listing Location :
> CleanPlanner.getPartitionPathsForFullCleaning
> --------------------------------------------------------------------------------
>
> Key: HUDI-1164
> URL: https://issues.apache.org/jira/browse/HUDI-1164
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Index
> Reporter: Balaji Varadarajan
> Priority: Major
> Fix For: 0.6.1
>
>
> This ticket is to track all known locations where we call
> FSUtils.getAllPartitionPaths
> This should only impact the first time we do clean. Incremental cleaner
> should reduce the scope of partition-paths to be listed. But again,
> consolidated metadata would effectively avoid file-system level listing
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
