[
https://issues.apache.org/jira/browse/AIRFLOW-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390489#comment-16390489
]
ASF subversion and git services commented on AIRFLOW-2150:
----------------------------------------------------------
Commit b8c2cea36299d6a3264d8bb1dc5a3995732b8855 in incubator-airflow's branch
refs/heads/master from [~kevinyang]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=b8c2cea ]
[AIRFLOW-2150] Use lighter call in HiveMetastoreHook().max_partition()
Call self.metastore.get_partition_names() instead of
self.metastore.get_partitions(), which is extremely expensive for
large tables, in HiveMetastoreHook().max_partition().
Closes #3082 from
yrqls21/kevin_yang_fix_hive_max_partition
> Use get_partition_names() instead of get_partitions() in
> HiveMetastoreHook().max_partition()
> --------------------------------------------------------------------------------------------
>
> Key: AIRFLOW-2150
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2150
> Project: Apache Airflow
> Issue Type: Bug
> Reporter: Kevin Yang
> Assignee: Kevin Yang
> Priority: Major
>
> get_partitions() is extremely expensive for large tables, max_partition()
> should be using get_partition_names() instead.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
