[ 
https://issues.apache.org/jira/browse/HDFS-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994727#comment-14994727
 ] 

Hudson commented on HDFS-9318:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #638 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/638/])
HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu (kihwal: 
rev bf6aa30a156b3c5cac5469014a5989e0dfdc7256)
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicyConsiderLoad.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
* 
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
* 
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockPlacementPolicyDefault.java


> considerLoad factor can be improved
> -----------------------------------
>
>                 Key: HDFS-9318
>                 URL: https://issues.apache.org/jira/browse/HDFS-9318
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.6.0
>            Reporter: Kuhu Shukla
>            Assignee: Kuhu Shukla
>             Fix For: 3.0.0, 2.8.0
>
>         Attachments: HDFS-9318-v1.patch, HDFS-9318-v2.patch
>
>
> Currently considerLoad avoids choosing nodes that are too active, so it helps 
> level the HDFS load across the cluster. Under normal conditions, this is 
> desired. However, when a cluster has a large percentage of nearly full nodes, 
> this can make it difficult to find good targets because the placement policy 
> wants to avoid the full nodes, but considerLoad wants to avoid the busy 
> less-full nodes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to