[
https://issues.apache.org/jira/browse/HIVE-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386112#comment-15386112
]
Ashutosh Chauhan commented on HIVE-14204:
-----------------------------------------
I see you added synchronized for metastore calls. This is as I expected. Better
path here could be to repurpose DbTxnManager::SynchronizedMetaStoreClient() as
a generic synchronized client.
But my question is this will hamper perf. But it will be good to measure it
since if there are very little gains after this then we may need to take
different approach.
> Optimize loading dynamic partitions
> ------------------------------------
>
> Key: HIVE-14204
> URL: https://issues.apache.org/jira/browse/HIVE-14204
> Project: Hive
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Priority: Minor
> Attachments: HIVE-14204.1.patch, HIVE-14204.3.patch
>
>
> Lots of time is spent in sequential fashion to load dynamic partitioned
> dataset in driver side. E.g simple dynamic partitioned load as follows takes
> 300+ seconds
> {noformat}
> INSERT INTO web_sales_test partition(ws_sold_date_sk) select * from
> tpcds_bin_partitioned_orc_200.web_sales;
> Time taken to load dynamic partitions: 309.22 seconds
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
