[
https://issues.apache.org/jira/browse/OOZIE-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryota Egashira updated OOZIE-2135:
----------------------------------
Description:
HCatClient.getPartitions is used to check partition existence in Oozie, but it
is known to be inefficient for large table with many partitions. Hive team
working on new method, partitionExists, which has performance optimization, and
Oozie should switch to this once committed.
[~mithun] could you please share Hive JIRA for reference?
> Partition existence check by HCatClient.getPartitions causes high load on
> HCatalog
> ----------------------------------------------------------------------------------
>
> Key: OOZIE-2135
> URL: https://issues.apache.org/jira/browse/OOZIE-2135
> Project: Oozie
> Issue Type: Bug
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
>
> HCatClient.getPartitions is used to check partition existence in Oozie, but
> it is known to be inefficient for large table with many partitions. Hive team
> working on new method, partitionExists, which has performance optimization,
> and Oozie should switch to this once committed.
> [~mithun] could you please share Hive JIRA for reference?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
