[
https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15818408#comment-15818408
]
Surendra Singh Lilhore commented on HDFS-11163:
-----------------------------------------------
bq. If the storage policy is unspecified at an inode, then the real effective
storage policy might be resolved via inheritance from the inode's ancestry.
As [~szetszwo] mentioned, HdfsLocatedFileStatus already has the resolved
storage policy. (If inode policy unspecified, it will inherit from ancestors).
This issue is only applicable if ancestors policy also unspecified, in this
case {{status.getStoragePolicy()}} will give
BLOCK_STORAGE_POLICY_ID_UNSPECIFIED.
We need namenode default storage policy which we can use in case of {{
BLOCK_STORAGE_POLICY_ID_UNSPECIFIED}}. We can add new field in
{{FsServerDefaults}} for default policy.
So we can do something like this...
{code}
final byte policyId = status.getStoragePolicy();
if (policyId == HdfsConstants.BLOCK_STORAGE_POLICY_ID_UNSPECIFIED) {
policyId = dfs.getServerDefaults().getDefaultStoragePolicy();
}
{code}
> Mover should move the file blocks to default storage once policy is unset
> -------------------------------------------------------------------------
>
> Key: HDFS-11163
> URL: https://issues.apache.org/jira/browse/HDFS-11163
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: balancer & mover
> Affects Versions: 2.8.0
> Reporter: Surendra Singh Lilhore
> Assignee: Surendra Singh Lilhore
> Attachments: HDFS-11163-001.patch, HDFS-11163-002.patch
>
>
> HDFS-9534 added new API in FileSystem to unset the storage policy. Once
> policy is unset blocks should move back to the default storage policy.
> Currently mover is not moving file blocks which have zero storage ID
> {code}
> // currently we ignore files with unspecified storage policy
> if (policyId == HdfsConstants.BLOCK_STORAGE_POLICY_ID_UNSPECIFIED) {
> return;
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
