[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495584#comment-14495584 ]
Li Bo commented on HDFS-8120: ----------------------------- bq. the DFSStripedOutputStream should not allocate a new block in NameNode When {{DFSStripedOutputStream}} requests a block group from NN, it also doesn't know how many blocks in this block group will be empty. The client may just wirte 1 byte, which makes most of the blocks in this block group empty. In {{DFSOutputStream}}, if the write bytes of a block is 0, {{DFSOutputStream#close()}} will not send an empty package to DN. The two situations are a little different. > Erasure coding: created util class to analyze striped block groups > ------------------------------------------------------------------ > > Key: HDFS-8120 > URL: https://issues.apache.org/jira/browse/HDFS-8120 > Project: Hadoop HDFS > Issue Type: Sub-task > Reporter: Zhe Zhang > Assignee: Zhe Zhang > Attachments: HDFS-8120.000.patch, HDFS-8120.001.patch, > HDFS-8120.002.patch, HDFS-8120.003.patch, HDFS-8120.004.patch > > > The patch adds logic of calculating size of individual blocks in a striped > block group. -- This message was sent by Atlassian JIRA (v6.3.4#6332)