[ 
https://issues.apache.org/jira/browse/HIVE-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13754963#comment-13754963
 ] 

Edward Capriolo commented on HIVE-5158:
---------------------------------------

A thing to keep in mind is that some tables with a huge number of partitions 
will OOM a client if you attempt to fetch them all at once. So some support for 
paging is required.
                
> allow getting all partitions for table to also use direct SQL path
> ------------------------------------------------------------------
>
>                 Key: HIVE-5158
>                 URL: https://issues.apache.org/jira/browse/HIVE-5158
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-5158.D12573.1.patch, HIVE-5158.D12573.2.patch, 
> HIVE-5158.D12573.3.patch, HIVE-5158.D12573.4.patch
>
>
> While testing some queries I noticed that getPartitions can be very slow 
> (which happens e.g. in non-strict mode with no partition column filter); with 
> a table with many partitions it can take 10-12s easily. SQL perf path can 
> also be used for this path.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to