[
https://issues.apache.org/jira/browse/YARN-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhijie Shen updated YARN-975:
-----------------------------
Attachment: YARN-975.1.patch
Talked to Vinod. We should created a history storage that groups the reader and
the writer interfaces to be consistent. Uploaded a patch of HDFS-based
implementation.
There're some addition points:
1. The reader APIs should allows throwing Throwable. For example, these APIs
will also fail due to the abnormal I/O.
2. Need to update the patch when YARN-956 is committed.
3. Need to add a test case for FileSystemHistoryStorage.
4. In this patch, we aim to make the end-to-end system work. We need to
optimize the performance of reading/writing the history data against HDFS later.
> Adding HDFS implementation for Writing Interface of History Storage
> -------------------------------------------------------------------
>
> Key: YARN-975
> URL: https://issues.apache.org/jira/browse/YARN-975
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Zhijie Shen
> Assignee: Zhijie Shen
> Attachments: YARN-975.1.patch
>
>
> HDFS implementation should be a standard persistence strategy of history
> storage
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
