[
https://issues.apache.org/jira/browse/HIVE-25205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mahesh kumar behera updated HIVE-25205:
---------------------------------------
Summary: Reduce overhead of partition column stat updation during batch
loading of partitions. (was: Reduce overhead of adding write notification log
during batch loading of partition.)
> Reduce overhead of partition column stat updation during batch loading of
> partitions.
> -------------------------------------------------------------------------------------
>
> Key: HIVE-25205
> URL: https://issues.apache.org/jira/browse/HIVE-25205
> Project: Hive
> Issue Type: Sub-task
> Components: Hive, HiveServer2
> Reporter: mahesh kumar behera
> Assignee: mahesh kumar behera
> Priority: Major
> Labels: performance
>
> During batch loading of partition the write notification logs are added for
> each partition added. This is causing delay in execution as the call to HMS
> is done for each partition. This can be optimised by adding a new API in HMS
> to send a batch of partition and then this batch can be added together to the
> backend database. Once we have a batch of notification log, at HMS side, code
> can be optimised to add the logs using single call to backend RDBMS.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
