Micah Whitacre created HIVE-17956: ------------------------------------- Summary: Retrieve "latest" partition from Hive Metastore Key: HIVE-17956 URL: https://issues.apache.org/jira/browse/HIVE-17956 Project: Hive Issue Type: New Feature Components: Metastore Reporter: Micah Whitacre
We are trying to utilize the Hive Metastore for our processing needs, specifically focusing on consuming through the HCatalog APIs. One use case we have is that we want to consume the "latest" partition. In researching there are a number of posts[1][2] that talk about using queries through Hive Server2 to find that information. It would be more ideal if this was a first class API offered from the Hive Metastore without requiring a query to be executed. The other option would be to retrieve all of the partitions and sort client side. There is a concern about the efficiency and memory requirements of this especially without the "iterator" concept implemented from HIVE-7195. [1] - https://community.hortonworks.com/questions/85330/how-to-optimize-hive-access-to-the-latest-partitio.html [2] - https://stackoverflow.com/questions/36095790/how-to-find-the-most-recent-partition-in-hive-table -- This message was sent by Atlassian JIRA (v6.4.14#64029)