[ 
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318144#comment-14318144
 ] 

Li Bo commented on HDFS-7729:
-----------------------------

Sorry for replying late.
1. Give simple handling of slow writers. For failure and slow writers, I think 
there may be many situations to consider, so I created HDFS-7786 to work on 
this issue.
2. I tried the code but found problems. The {{LocatedBlock}} I got has 
locations in different order comparing to the locations got through 
{{ClientProtocol.addBlock()}}. Could you check it again?
3.Different streamers have different {{bytesCurBlock}},{{currentSeqNo}}, etc, 
so I think it's better to put them inside DataStreamer. 
4.Normally a packet contains 127 chunks(a chunk is 512 bytes). And cell size 
must be divided exactly by block size, so it's not appropriate to unify cell 
size and packet size.
5.  I have add two test cases for multiple block groups. It seems no function 
need to be associated with {{@Before}} and {{@After}}.

My IDE already uses 2 spaces, and I didn’t find any line with 4 spaces.Could 
you show me the lines?


> Add logic to DFSOutputStream to support writing a file in striping layout 
> --------------------------------------------------------------------------
>
>                 Key: HDFS-7729
>                 URL: https://issues.apache.org/jira/browse/HDFS-7729
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Li Bo
>         Attachments: Codec-tmp.patch, HDFS-7729-001.patch, 
> HDFS-7729-002.patch, HDFS-7729-003.patch, HDFS-7729-004.patch, 
> HDFS-7729-005.patch, HDFS-7729-006.patch, HDFS-7729-007.patch
>
>
> If client wants to directly write a file striping layout, we need to add some 
> logic to DFSOutputStream.  DFSOutputStream needs multiple DataStreamers to 
> write each cell of a stripe to a remote datanode. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to