[ 
https://issues.apache.org/jira/browse/HIVE-24070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17183861#comment-17183861
 ] 

Anishek Agarwal commented on HIVE-24070:
----------------------------------------

can you give some more details on this please, i thought the config introduced 
as part of HIVE-19430 allows us to control how many events we want to delete. 
however looks like there should be an inner loop since if the number of events 
generated in sleepTime are more than deleted due to EVENT_CLEAN_MAX_EVENTS then 
the db will never get cleaned.

cc [~aasha] / [~pkumarsinha]

> ObjectStore.cleanWriteNotificationEvents OutOfMemory on large number of 
> pending events
> --------------------------------------------------------------------------------------
>
>                 Key: HIVE-24070
>                 URL: https://issues.apache.org/jira/browse/HIVE-24070
>             Project: Hive
>          Issue Type: Bug
>          Components: repl
>    Affects Versions: 4.0.0
>            Reporter: Ramesh Kumar Thangarajan
>            Assignee: Ramesh Kumar Thangarajan
>            Priority: Major
>             Fix For: 4.0.0
>
>
> If there are large number of events that haven't been cleaned up for some 
> reason, then ObjectStore.cleanWriteNotificationEvents() can run out of memory 
> while it loads all the events to be deleted.
>  It should fetch events in batches.
> Similar to https://issues.apache.org/jira/browse/HIVE-19430



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to