[ 
https://issues.apache.org/jira/browse/HDFS-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kihwal Lee reassigned HDFS-8864:
--------------------------------

    Assignee: Kihwal Lee

> Padding is needed in remaining space check
> ------------------------------------------
>
>                 Key: HDFS-8864
>                 URL: https://issues.apache.org/jira/browse/HDFS-8864
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Kihwal Lee
>            Assignee: Kihwal Lee
>            Priority: Critical
>
> The RBW reservation feature removed the padding of 5 block worth of space in 
> the remaining space check.  But when disks are close to being full, a small 
> accounting errors can make block creations to fail on the datanode. One 
> obvious source of such error is the slow control loop formed by heartbeats.
> We have been testing a patch which adjusts the padding based on the heartbeat 
> interval and it seems to be working fine.  At the default 3 second heartbeat 
> interval, the padding becomes 6 blocks, which is close to the previous value 
> of 5.  If a longer heartbeat interval is used, this will increase.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to