[ 
https://issues.apache.org/jira/browse/HADOOP-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hairong Kuang updated HADOOP-1908:
----------------------------------

    Attachment: datanodeRestructure.patch

This patch includes all of Raghu's new comments:
1. Remove additional check for null streams. It also makes BlockSender & 
BlockReceiver to be "Closable", so we can use IOUtils.closeStream to close 
block senders & receivers.
2. Add code to receive the response for a block write request so it eliminates 
the additional exception thrown by a data node when sends write response back. 
But the code ignores the response for now and leaves HADOOP-1927 to correctly 
handle the response.
3. DFSClient sends a "0" to mark the end of a block. I also marked the protocol 
change in the comment of DATA_TRANSFER_VERSION increment.

> Restructure data node code so that block sending/receiving is seperated from 
> data transfer header handling
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1908
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1908
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: dfs
>    Affects Versions: 0.14.1
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>             Fix For: 0.15.0
>
>         Attachments: datanode.patch, datanodeRestructure.patch, 
> datanodeRestructure.patch
>
>
> This jira is intended for code sharing. I'd like to have a BlockSender which 
> is resposible for reading a block from a disk and writing it to an output 
> stream, and a BlockReceiver which receives a block from an input stream, 
> writes it to a disk,  and possibly writes it a mirror ouput stream to support 
> pipeline writes. Block sender and receiver code is independent of any block 
> IO protocols so it could be shared by block transfer, block write, block 
> read, and future block replacement introduced by data node rebalancing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to