[ 
https://issues.apache.org/jira/browse/HIVE-19251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16445007#comment-16445007
 ] 

Daniel Dai commented on HIVE-19251:
-----------------------------------

That's true we'd better provide batch API for potentially large results. That 
involves metastore api and rawstore api changes of multiple calls. I'd like to 
limit the scope of this ticket as this is mainly a specific bug fix and we can 
open new ticket for batch improvement if needed.

> ObjectStore.getNextNotification with LIMIT should use less memory
> -----------------------------------------------------------------
>
>                 Key: HIVE-19251
>                 URL: https://issues.apache.org/jira/browse/HIVE-19251
>             Project: Hive
>          Issue Type: Bug
>          Components: repl, Standalone Metastore
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>            Priority: Major
>         Attachments: HIVE-19251.1.patch
>
>
> Experience OOM when Hive metastore try to retrieve huge amount of 
> notification logs even there's limit clause. Hive shall only retrieve 
> necessary rows.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to