Jonathan Eagles created YARN-3448: ------------------------------------- Summary: Add Rolling Time To Lives Level DB Plugin Capabilities Key: YARN-3448 URL: https://issues.apache.org/jira/browse/YARN-3448 Project: Hadoop YARN Issue Type: Improvement Reporter: Jonathan Eagles
For large applications, the majority of the time in LeveldbTimelineStore is spent deleting old entities record at a time. A write lock is held during the entire deletion phase which in practice can be hours. An alternative is to create a rolling set of databases that age out and can be efficiently removed via a recursive directory delete. The removes the lock in the deletion thread and clients and servers can share access to the underlying database which already implements its only internal locking mechanism. -- This message was sent by Atlassian JIRA (v6.3.4#6332)