[
https://issues.apache.org/jira/browse/HADOOP-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao updated HADOOP-11577:
--------------------------------
Description:
HDFS-2832 enable support for heterogeneous storages in HDFS, which allows DN as
a collection of storages with different types. However, I can't find document
on how to label different storage types from the following two documents. I
found the information from the design spec.It will be good we document this for
admins and users to use the related Archival storage and storage policy
features.
http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html
http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
This JIRA is opened to add document for the new storage type labels. I propose
to add an example under ArchivalStorage.html#Configuration section:
{code}
<property>
<name>dfs.data.dir</name>
<value>[DISK]file:///hddata/dn/disk0,
[SSD]file:///hddata/dn/ssd0,[ARCHIVE]file:///hddata/dn/archive0</value>,
</property>
{code}
Also add a short description of [DISK/SSD/ARCHIVE/RAM_DISK] options in
hdfs-default.xml#dfs.data.dir and document DISK as storage type if no storage
type is labeled in the data node storage location configuration.
was:
HDFS-2832 enable support for heterogeneous storages in HDFS, which allows DN as
a collection of storages with different types. However, I can't find document
on how to label different storage types from the following two documents. I
found the information from the design spec.It will be good we document this for
admins and users to use the related Archival storage and storage policy
features.
http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html
http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
This JIRA is opened to add document for the new storage type labels. I propose
to add an example under ArchivalStorage.html#Configuration section:
{code}
<property>
<name>dfs.data.dir</name>
<value>[DISK]file:///hddata/dn/disk0,
[SSD]file:///hddata/dn/ssd0,[ARCHIVAL]file:///hddata/dn/archival0</value>,
</property>
{code}
Also add a short description of [DISK/SSD/ARCHIVAL/RAM_DISK] options in
hdfs-default.xml#dfs.data.dir and document DISK as storage type if no storage
type is labeled in the data node storage location configuration.
> Need document for storage type label of data node storage locations under
> dfs.data.dir
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-11577
> URL: https://issues.apache.org/jira/browse/HADOOP-11577
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 2.6.0
> Reporter: Xiaoyu Yao
> Assignee: Xiaoyu Yao
>
> HDFS-2832 enable support for heterogeneous storages in HDFS, which allows DN
> as a collection of storages with different types. However, I can't find
> document on how to label different storage types from the following two
> documents. I found the information from the design spec.It will be good we
> document this for admins and users to use the related Archival storage and
> storage policy features.
> http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html
> http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
> This JIRA is opened to add document for the new storage type labels. I
> propose to add an example under ArchivalStorage.html#Configuration section:
> {code}
> <property>
> <name>dfs.data.dir</name>
> <value>[DISK]file:///hddata/dn/disk0,
> [SSD]file:///hddata/dn/ssd0,[ARCHIVE]file:///hddata/dn/archive0</value>,
> </property>
> {code}
> Also add a short description of [DISK/SSD/ARCHIVE/RAM_DISK] options in
> hdfs-default.xml#dfs.data.dir and document DISK as storage type if no storage
> type is labeled in the data node storage location configuration.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
