[
https://issues.apache.org/jira/browse/HDFS-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217519#comment-15217519
]
Hudson commented on HDFS-5177:
------------------------------
FAILURE: Integrated in Hadoop-trunk-Commit #9526 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/9526/])
HDFS-5177. blocksScheduled count should be decremented for abandoned
(vinayakumarb: rev 09d63d5a192b5d6b172f94ff6c94da348fd49ea6)
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeStorageInfo.java
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestBlocksScheduledCounter.java
> blocksScheduled count should be decremented for abandoned blocks
> -----------------------------------------------------------------
>
> Key: HDFS-5177
> URL: https://issues.apache.org/jira/browse/HDFS-5177
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: namenode
> Affects Versions: 3.0.0, 2.1.0-beta
> Reporter: Vinayakumar B
> Assignee: Vinayakumar B
> Fix For: 2.8.0
>
> Attachments: HDFS-5177-04.patch, HDFS-5177-05.patch, HDFS-5177.patch,
> HDFS-5177.patch, HDFS-5177.patch
>
>
> DatanodeDescriptor#incBlocksScheduled() will be called for all datanodes of
> the block on each allocation. But same should be decremented for abandoned
> blocks.
> When one of the datanodes is down and same is allocated for the block along
> with other live datanodes, then this block will be abandoned, but the
> scheduled count on other datanodes will consider live datanodes as loaded,
> but in reality these datanodes may not be loaded.
> Anyway this scheduled count will be rolled every 20 mins.
> Problem will come if the rate of creation of files is more. Due to increase
> in the scheduled count, there might be chances of missing local datanode to
> write to. and some times writes also can fail in small clusters.
> So we need to decrement the unnecessary count on abandon block call.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
