[ 
https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15092772#comment-15092772
 ] 

Mingliang Liu commented on YARN-4265:
-------------------------------------

Hi [~djp] and [~gtCarrera9],

{quote}
For HDFS, any file update should reflect the modification time to parent 
directory. Any exception case here?
{quote}

For creating/moving files in an existing directory, the modification time of 
the parent directory will be updated. Refer to [code 
here|https://github.com/apache/hadoop/blob/9b8e50b424d060e16c1175b1811e7abc476e2468/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java#L1058-L1058].

However, should this jira consider appending to an existing file, the 
modification time of the parent directory will not be updated. Refer to [code 
here|https://github.com/apache/hadoop/blob/ab56fcdb1219d03713b408dd3a95d7405635254d/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirAppendOp.java#L77-L77].

Thanks.

> Provide new timeline plugin storage to support fine-grained entity caching
> --------------------------------------------------------------------------
>
>                 Key: YARN-4265
>                 URL: https://issues.apache.org/jira/browse/YARN-4265
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Li Lu
>            Assignee: Li Lu
>         Attachments: YARN-4265-trunk.001.patch, YARN-4265-trunk.002.patch, 
> YARN-4265-trunk.003.patch, YARN-4265-trunk.004.patch, 
> YARN-4265.YARN-4234.001.patch, YARN-4265.YARN-4234.002.patch
>
>
> To support the newly proposed APIs in YARN-4234, we need to create a new 
> plugin timeline store. The store may have similar behavior as the 
> EntityFileTimelineStore proposed in YARN-3942, but cache date in cache id 
> granularity, instead of application id granularity. Let's have this storage 
> as a standalone one, instead of updating EntityFileTimelineStore, to keep the 
> existing store (EntityFileTimelineStore) stable. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to