Li Lu updated YARN-4265:
    Attachment: YARN-4265-trunk.poc_001.patch

This is a proof-of-concept patch for the proposed improvement. This patch is 
largely based on the work in YARN-3942. In this patch we added a new storage 
plugin to accommodate the newly added cache id concept. As in YARN-4234, entity 
logs are stored in <active/done dir 
name>/app_id/attampt_id/<prefix>-cache_id.log. The newly added plugin can with 
with this new directory structure, and can refresh (reload) entity logs in a 
cache id granularity (rather than application granularity). 

> Provide new timeline plugin storage to support fine-grained entity caching
> --------------------------------------------------------------------------
>                 Key: YARN-4265
>                 URL: https://issues.apache.org/jira/browse/YARN-4265
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Li Lu
>            Assignee: Li Lu
>         Attachments: YARN-4265-trunk.poc_001.patch
> To support the newly proposed APIs in YARN-4234, we need to create a new 
> plugin timeline store. The store may have similar behavior as the 
> EntityFileTimelineStore proposed in YARN-3942, but cache date in cache id 
> granularity, instead of application id granularity. Let's have this storage 
> as a standalone one, instead of updating EntityFileTimelineStore, to keep the 
> existing store (EntityFileTimelineStore) stable. 

This message was sent by Atlassian JIRA

Reply via email to