[
https://issues.apache.org/jira/browse/HIVE-22964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049932#comment-17049932
]
Aditya Shah edited comment on HIVE-22964 at 3/3/20 6:22 AM:
------------------------------------------------------------
Adding threadpool to processPathforMMRead
[~gopalv] [~pvary] [~prasanth_j] can you please review. Thanks!
was (Author: aditya-shah):
Adding threadpool to processPathforMMRead
> MM table split computation is very slow
> ---------------------------------------
>
> Key: HIVE-22964
> URL: https://issues.apache.org/jira/browse/HIVE-22964
> Project: Hive
> Issue Type: Improvement
> Reporter: Aditya Shah
> Assignee: Aditya Shah
> Priority: Major
> Attachments: HIVE-22964.patch
>
>
> Since for MM table we process the paths prior to inputFormat.getSplits() we
> end up doing listing on the whole table at once. This could be optimized.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
