[ 
https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483991#comment-14483991
 ] 

Zhe Zhang commented on HDFS-8059:
---------------------------------

bq. Therefore if we really need to save memory in the future, we can even skip 
the two numbers in the INodeFile level maybe.
This is a little expensive, as traversing the name space to dir level requires 
a read lock. And NameNode frequently needs EC policy info (e.g. to get desired 
number of storage locations).

> Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to 
> INodeFile
> ---------------------------------------------------------------------------------------
>
>                 Key: HDFS-8059
>                 URL: https://issues.apache.org/jira/browse/HDFS-8059
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>    Affects Versions: HDFS-7285
>            Reporter: Yi Liu
>            Assignee: Yi Liu
>         Attachments: HDFS-8059.001.patch
>
>
> Move {{dataBlockNum}} and {{parityBlockNum}} from BlockInfoStriped to 
> INodeFile, and store them in {{FileWithStripedBlocksFeature}}.
> Ideally these two nums are the same for all striped blocks in a file, and 
> store them in BlockInfoStriped will waste NN memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to