Hitesh Shah commented on YARN-3942:

Some ideas from an offline discussion with [~bikassaha] and [~vinodkv]:

    - option 1) Could we just use leveldb as an LRU cache instead of a memory 
based cache to handle the OOM issue?
    - option 2) Could we just take the data from HDFS and write it out to 
leveldb and using the level db to serve data out? This would address the OOM 
issue too. 

\cc [~jlowe] [~jeagles]

> Timeline store to read events from HDFS
> ---------------------------------------
>                 Key: YARN-3942
>                 URL: https://issues.apache.org/jira/browse/YARN-3942
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: timelineserver
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>         Attachments: YARN-3942.001.patch
> This adds a new timeline store plugin that is intended as a stop-gap measure 
> to mitigate some of the issues we've seen with ATS v1 while waiting for ATS 
> v2.  The intent of this plugin is to provide a workable solution for running 
> the Tez UI against the timeline server on a large-scale clusters running many 
> thousands of jobs per day.

This message was sent by Atlassian JIRA

Reply via email to