[ 
https://issues.apache.org/jira/browse/HDFS-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Haohui Mai updated HDFS-7265:
-----------------------------
    Labels:   (was: BB2015-05-TBR)

> Use a throttler for replica write in datanode
> ---------------------------------------------
>
>                 Key: HDFS-7265
>                 URL: https://issues.apache.org/jira/browse/HDFS-7265
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>         Attachments: h7265_20141018.patch
>
>
> BlockReceiver process packets in BlockReceiver.receivePacket() as follows
> # read from socket
> # enqueue the ack
> # write to downstream
> # write to disk
> The above steps is repeated for each packet in a single thread.  When there 
> are a lot of concurrent writes in a datanode, the write time in #4 becomes 
> very long.  As a result, it leads to SocketTimeoutException since it cannot 
> read from the socket for a long time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to