[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318144#comment-14318144
]
Li Bo commented on HDFS-7729:
-----------------------------
Sorry for replying late.
1. Give simple handling of slow writers. For failure and slow writers, I think
there may be many situations to consider, so I created HDFS-7786 to work on
this issue.
2. I tried the code but found problems. The {{LocatedBlock}} I got has
locations in different order comparing to the locations got through
{{ClientProtocol.addBlock()}}. Could you check it again?
3.Different streamers have different {{bytesCurBlock}},{{currentSeqNo}}, etc,
so I think it's better to put them inside DataStreamer.
4.Normally a packet contains 127 chunks(a chunk is 512 bytes). And cell size
must be divided exactly by block size, so it's not appropriate to unify cell
size and packet size.
5. I have add two test cases for multiple block groups. It seems no function
need to be associated with {{@Before}} and {{@After}}.
My IDE already uses 2 spaces, and I didn’t find any line with 4 spaces.Could
you show me the lines?
> Add logic to DFSOutputStream to support writing a file in striping layout
> --------------------------------------------------------------------------
>
> Key: HDFS-7729
> URL: https://issues.apache.org/jira/browse/HDFS-7729
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Li Bo
> Assignee: Li Bo
> Attachments: Codec-tmp.patch, HDFS-7729-001.patch,
> HDFS-7729-002.patch, HDFS-7729-003.patch, HDFS-7729-004.patch,
> HDFS-7729-005.patch, HDFS-7729-006.patch, HDFS-7729-007.patch
>
>
> If client wants to directly write a file striping layout, we need to add some
> logic to DFSOutputStream. DFSOutputStream needs multiple DataStreamers to
> write each cell of a stripe to a remote datanode.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)