[ 
https://issues.apache.org/jira/browse/HIVE-28200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhihua Deng resolved HIVE-28200.
--------------------------------
    Fix Version/s: 4.1.0
       Resolution: Fixed

Fix has been pushed to master. Thank you for the PR [~wechar] !

> Improve get_partitions_by_filter/expr when partition limit enabled
> ------------------------------------------------------------------
>
>                 Key: HIVE-28200
>                 URL: https://issues.apache.org/jira/browse/HIVE-28200
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>            Reporter: Wechar
>            Assignee: Wechar
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.1.0
>
>
> When {{hive.metastore.limit.partition.request}} is configured, HMS would get 
> the matching partition counts before get the real partition objects. The 
> count  could be a slow query if the input filter or expr is too complex.
> In this case, such slow filter will be executed in both counting partition 
> numbers and fetching real partition objects, which harms the performance and 
> backend DBMS.
> We can make an improvement by getting matched partition names firstly, and 
> then check limit through the size of partition names, and finally get the 
> partitions by the partition names.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to