[
https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15320159#comment-15320159
]
Jing Zhao edited comment on HDFS-10473 at 6/8/16 7:08 AM:
----------------------------------------------------------
bq. To simplify, how about Mover tool allows to move EC files only if the
target policy is ARCHIVE/ALL_SDD? We can just log saying, this policy is not
recommended for striped EC files, so ignoring for movements.
Yes, we can do this by now. On the NN side, one possible solution is to ignore
certain storage policies when we choose storage targets for a being-written EC
file. This way can minimize the change and avoid extra O\(n\) check. Either
change needs to update the current documentation I think.
was (Author: jingzhao):
bq. To simplify, how about Mover tool allows to move EC files only if the
target policy is ARCHIVE/ALL_SDD? We can just log saying, this policy is not
recommended for striped EC files, so ignoring for movements.
Yes, we can do this by now. On the NN side, one possible solution is to ignore
certain storage policies when we choose storage targets for a being-written EC
file. This way can minimize the change and avoid extra O(n) check. Either
change needs to update the current documentation I think.
> Allow only suitable storage policies to be set on striped files
> ---------------------------------------------------------------
>
> Key: HDFS-10473
> URL: https://issues.apache.org/jira/browse/HDFS-10473
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: namenode
> Reporter: Uma Maheswara Rao G
> Assignee: Uma Maheswara Rao G
> Attachments: HDFS-10473-01.patch
>
>
> Currently some of existing storage policies are not suitable for striped
> layout files.
> This JIRA proposes to reject setting storage policy on striped files.
> Another thought is to allow only suitable storage polices like ALL_SSD.
> Since the major use case of EC is for cold data, this may not be at high
> importance. So, I am ok to reject setting storage policy on striped files at
> this stage. Please suggest if others have some thoughts on this.
> Thanks [~zhz] for offline discussion on this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
