[ 
https://issues.apache.org/jira/browse/HDFS-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129776#comment-15129776
 ] 

Junping Du commented on HDFS-9456:
----------------------------------

Thanks for updating the patch, [~xiaobingo]! There is an issue with calculating 
minNodeGroups:
{code}
+    int minNodeGroups = 2;
+    minNodeGroups = Math.min(minNodeGroups, numberOfReplicas);
{code}
We are expecting no replica get duplicated on the same NodeGroup (at least for 
VM case). This is because NodeGroup means the same locality & failure group 
which won't have any benefit with putting replicas more than 1. Thus, here 
minNodeGroups should set to numberOfReplicas directly. 
Other looks good.
CC [~szetszwo].

> BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement
> ----------------------------------------------------------------------
>
>                 Key: HDFS-9456
>                 URL: https://issues.apache.org/jira/browse/HDFS-9456
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Junping Du
>            Assignee: Xiaobing Zhou
>         Attachments: HDFS-9456.001.patch, HDFS-9456.002.patch
>
>
> Per discussions in HDFS-9314, we need to override verifyBlockPlacement() in 
> BlockPlacementPolicyWithNodeGroup to reflect right block status.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to