[
https://issues.apache.org/jira/browse/YARN-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795391#comment-13795391
]
Vinod Kumar Vavilapalli commented on YARN-975:
----------------------------------------------
Looks good overall. One file per app is reasonable. We already use TFile for
log-aggregation, so yeah it is good to pick that up too.
Regarding the implementation, see JobHistoryEventHandler. There we flush based
on two triggers: An upper limit on unflushed records and a time-based trigger.
We can add one more trigger: Application state change.
> Add a file-system implementation for history-storage
> ----------------------------------------------------
>
> Key: YARN-975
> URL: https://issues.apache.org/jira/browse/YARN-975
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Zhijie Shen
> Assignee: Zhijie Shen
> Attachments: YARN-975.1.patch, YARN-975.2.patch, YARN-975.3.patch,
> YARN-975.4.patch, YARN-975.5.patch
>
>
> HDFS implementation should be a standard persistence strategy of history
> storage
--
This message was sent by Atlassian JIRA
(v6.1#6144)