[jira] [Updated] (YARN-3841) [Storage implementation] Create HDFS backing storage implementation for ATS writes

2015-07-01 Thread Tsuyoshi Ozawa (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsuyoshi Ozawa updated YARN-3841:
-
Attachment: YARN-3841.001.patch

Attaching a first patch to convert the implementation into FileSystem based one.

[~sjlee0] [~zjshen] could you take a look?

 [Storage implementation] Create HDFS backing storage implementation for ATS 
 writes
 --

 Key: YARN-3841
 URL: https://issues.apache.org/jira/browse/YARN-3841
 Project: Hadoop YARN
  Issue Type: Sub-task
  Components: timelineserver
Reporter: Tsuyoshi Ozawa
Assignee: Tsuyoshi Ozawa
 Attachments: YARN-3841.001.patch


 HDFS backing storage is useful for following scenarios.
 1. For Hadoop clusters which don't run HBase.
 2. For fallback from HBase when HBase cluster is temporary unavailable. 
 Quoting ATS design document of YARN-2928:
 {quote}
 In the case the HBase
 storage is not available, the plugin should buffer the writes temporarily 
 (e.g. HDFS), and flush
 them once the storage comes back online. Reading and writing to hdfs as the 
 the backup storage
 could potentially use the HDFS writer plugin unless the complexity of 
 generalizing the HDFS
 writer plugin for this purpose exceeds the benefits of reusing it here.
 {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3841) [Storage implementation] Create HDFS backing storage implementation for ATS writes

2015-06-22 Thread Tsuyoshi Ozawa (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsuyoshi Ozawa updated YARN-3841:
-
Summary: [Storage implementation] Create HDFS backing storage 
implementation for ATS writes  (was: [Storage abstraction] Create HDFS backing 
storage implementation for ATS writes)

 [Storage implementation] Create HDFS backing storage implementation for ATS 
 writes
 --

 Key: YARN-3841
 URL: https://issues.apache.org/jira/browse/YARN-3841
 Project: Hadoop YARN
  Issue Type: Sub-task
  Components: timelineserver
Reporter: Tsuyoshi Ozawa
Assignee: Tsuyoshi Ozawa

 HDFS backing storage is useful for following scenarios.
 1. For Hadoop clusters which don't run HBase.
 2. For fallback from HBase when HBase cluster is temporary unavailable. 
 Quoting ATS design document of YARN-2928:
 {quote}
 In the case the HBase
 storage is not available, the plugin should buffer the writes temporarily 
 (e.g. HDFS), and flush
 them once the storage comes back online. Reading and writing to hdfs as the 
 the backup storage
 could potentially use the HDFS writer plugin unless the complexity of 
 generalizing the HDFS
 writer plugin for this purpose exceeds the benefits of reusing it here.
 {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)