[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Li Lu updated YARN-3942: ------------------------ Attachment: YARN-3942-leveldb.001.patch Thanks [~jlowe] for working on this! On top of the existing patch I built a new storage to move the in memory hash map storage to a level db database. The original in memory timeline store is not supposed to be used in production environments. The price for the new level db hash map storage is latency: it generally takes more time to fully load the entities into level db. Had an offline discussion with [~xgong] and seems like we need to reduce the granularity of caching to improve latency. We may want to address this problem in a separate JIRA. > Timeline store to read events from HDFS > --------------------------------------- > > Key: YARN-3942 > URL: https://issues.apache.org/jira/browse/YARN-3942 > Project: Hadoop YARN > Issue Type: Improvement > Components: timelineserver > Reporter: Jason Lowe > Assignee: Jason Lowe > Attachments: YARN-3942-leveldb.001.patch, YARN-3942.001.patch > > > This adds a new timeline store plugin that is intended as a stop-gap measure > to mitigate some of the issues we've seen with ATS v1 while waiting for ATS > v2. The intent of this plugin is to provide a workable solution for running > the Tez UI against the timeline server on a large-scale clusters running many > thousands of jobs per day. -- This message was sent by Atlassian JIRA (v6.3.4#6332)