[
https://issues.apache.org/jira/browse/HUDI-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1479:
---------------------------------
Description:
- Can be done once rfc-15 is merged into master.
- We will also use HoodieEngineContext and perform parallelized listing as
needed.
- HoodieBackedTableMetadata#getPartitionsToFilesMapping has some parallelized
code
- Chase down direct usages of FileSystemBackedTableMetadata and parallelize
them as well
was:
- Can be done once rfc-15 is merged into master.
- We will also use HoodieEngineContext and perform parallelized listing as
needed.
- Chase down direct usages of FileSystemBackedTableMetadata and parallelize
them as well
> Replace FSUtils.getAllPartitionPaths() with
> HoodieTableMetadata#getAllPartitionPaths()
> --------------------------------------------------------------------------------------
>
> Key: HUDI-1479
> URL: https://issues.apache.org/jira/browse/HUDI-1479
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Code Cleanup
> Reporter: Vinoth Chandar
> Assignee: Vinoth Chandar
> Priority: Blocker
> Fix For: 0.7.0
>
>
> - Can be done once rfc-15 is merged into master.
> - We will also use HoodieEngineContext and perform parallelized listing as
> needed.
> - HoodieBackedTableMetadata#getPartitionsToFilesMapping has some
> parallelized code
> - Chase down direct usages of FileSystemBackedTableMetadata and parallelize
> them as well
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
