Jonathan Eagles created YARN-3448:
-------------------------------------

             Summary: Add Rolling Time To Lives Level DB Plugin Capabilities
                 Key: YARN-3448
                 URL: https://issues.apache.org/jira/browse/YARN-3448
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Jonathan Eagles


For large applications, the majority of the time in LeveldbTimelineStore is 
spent deleting old entities record at a time. A write lock is held during the 
entire deletion phase which in practice can be hours. An alternative is to 
create a rolling set of databases that age out and can be efficiently removed 
via a recursive directory delete. The removes the lock in the deletion thread 
and clients and servers can share access to the underlying database which 
already implements its only internal locking mechanism.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to