Jonathan Eagles created YARN-3448:

             Summary: Add Rolling Time To Lives Level DB Plugin Capabilities
                 Key: YARN-3448
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Jonathan Eagles

For large applications, the majority of the time in LeveldbTimelineStore is 
spent deleting old entities record at a time. A write lock is held during the 
entire deletion phase which in practice can be hours. An alternative is to 
create a rolling set of databases that age out and can be efficiently removed 
via a recursive directory delete. The removes the lock in the deletion thread 
and clients and servers can share access to the underlying database which 
already implements its only internal locking mechanism.

This message was sent by Atlassian JIRA

Reply via email to