[ 
https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-7343:
----------------------------
       Assignee: Wei Zhou  (was: Kai Zheng)
    Description: 
As discussed in HDFS-7285, it would be better to have a comprehensive and 
flexible storage policy engine considering file attributes, metadata, data 
temperature, storage type, EC codec, available hardware capabilities, 
user/application preference and etc.

Modified the title for re-purpose.
We'd extend this effort some bit and aim to work on a comprehensive solution to 
provide smart storage management service in order for convenient, intelligent 
and effective utilizing of erasure coding or replicas, HDFS cache facility, HSM 
offering, and all kinds of tools (balancer, mover, disk balancer and so on) in 
a large cluster.


  was:
As discussed in HDFS-7285, it would be better to have a comprehensive and 
flexible storage policy engine considering file attributes, metadata, data 
temperature, storage type, EC codec, available hardware capabilities, 
user/application preference and etc.


    Component/s:     (was: namenode)
        Summary: HDFS smart storage management  (was: A comprehensive and 
flexible storage policy engine)

Modified the title for re-purpose.

We'd extend this effort some bit and aim to work on a comprehensive solution to 
provide smart storage management service in order for convenient, intelligent 
and effective utilizing of erasure coding or replicas, HDFS cache facility, HSM 
offering, and all kinds of tools (balancer, mover, disk balancer and so on) in 
a large cluster. 

Doing this as a standalone service to avoid big impact to existing NNs was 
inspired by [~jingzhao] quite some time ago, along with many other valuable 
insights. [~zhouwei] will work on this and let's wait another week for the 
delayed design.

> HDFS smart storage management
> -----------------------------
>
>                 Key: HDFS-7343
>                 URL: https://issues.apache.org/jira/browse/HDFS-7343
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Kai Zheng
>            Assignee: Wei Zhou
>
> As discussed in HDFS-7285, it would be better to have a comprehensive and 
> flexible storage policy engine considering file attributes, metadata, data 
> temperature, storage type, EC codec, available hardware capabilities, 
> user/application preference and etc.
> Modified the title for re-purpose.
> We'd extend this effort some bit and aim to work on a comprehensive solution 
> to provide smart storage management service in order for convenient, 
> intelligent and effective utilizing of erasure coding or replicas, HDFS cache 
> facility, HSM offering, and all kinds of tools (balancer, mover, disk 
> balancer and so on) in a large cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to