[
https://issues.apache.org/jira/browse/HIVE-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated HIVE-13901:
------------------------------------
Attachment: HIVE-13901.1.patch
Creating an external table (tpcds inventory/web_sales) in S3 and running msck
on it took lot longer time.
inventory (tpcds):
============
msck time taken before patch:193.273 seconds
msck time taken after patch:71 seconds
web_sales (tpcds):
============
msck time taken before patch:1335.19 seconds
msck time taken after patch:471.264 seconds
> Hivemetastore add partitions can be slow depending on filesystems
> -----------------------------------------------------------------
>
> Key: HIVE-13901
> URL: https://issues.apache.org/jira/browse/HIVE-13901
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
> Reporter: Rajesh Balamohan
> Priority: Minor
> Attachments: HIVE-13901.1.patch
>
>
> Depending on FS, creating external tables & adding partitions can be
> expensive (e.g msck which adds all partitions).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
