[
https://issues.apache.org/jira/browse/HUDI-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17127229#comment-17127229
]
Balaji Varadarajan commented on HUDI-999:
-----------------------------------------
cc [~uditme]
> Parallelize listing of Source dataset partitions
> -------------------------------------------------
>
> Key: HUDI-999
> URL: https://issues.apache.org/jira/browse/HUDI-999
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: bootstrap
> Reporter: Balaji Varadarajan
> Priority: Major
>
> Currently, we are using single thread in driver to list all partitions in
> Source dataset. This is a bottleneck when doing metadata bootstrap.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
