[ 
https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742796#comment-14742796
 ] 

Walter Su commented on HDFS-9040:
---------------------------------

bq. preallocate GS when NN creates a new striped block group 
(FSN#createNewBlock). For each new striped block group we can reserve 
NUM_PARITY_BLOCKS GS's. Then steps 1~3 in the above sequence can be saved. 
Good idea Zhe. I have a concern that every time {{createBlockOutputStream}} 
requires a fresh blockToken. (It doesn't matter token expires during streaming.)

> Erasure coding: A BlockGroupDataStreamer to rule all internal blocks streamers
> ------------------------------------------------------------------------------
>
>                 Key: HDFS-9040
>                 URL: https://issues.apache.org/jira/browse/HDFS-9040
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Walter Su
>            Assignee: Walter Su
>         Attachments: HDFS-9040.00.patch, HDFS-9040.001.wip.patch
>
>
> A {{BlockGroupDataStreamer}} to communicate with NN to allocate/update block, 
> and {{StripedDataStreamer}} s only have to stream blocks to DNs. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to