[
https://issues.apache.org/jira/browse/HDFS-16439?focusedWorklogId=715578&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-715578
]
ASF GitHub Bot logged work on HDFS-16439:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 26/Jan/22 10:26
Start Date: 26/Jan/22 10:26
Worklog Time Spent: 10m
Work Description: jianghuazhu opened a new pull request #3937:
URL: https://github.com/apache/hadoop/pull/3937
### Description of PR
It should be simpler to compute numOfReplicas when
BlockPlacementPolicyDefault#getMaxNodesPerRack() is executed. This is the
purpose of this pr.
Details: HDFS-16439
### How was this patch tested?
For testing, there is not much pressure.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 715578)
Remaining Estimate: 0h
Time Spent: 10m
> Makes calculating maxNodesPerRack simpler
> -----------------------------------------
>
> Key: HDFS-16439
> URL: https://issues.apache.org/jira/browse/HDFS-16439
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: namenode
> Affects Versions: 3.4.0
> Reporter: JiangHua Zhu
> Assignee: JiangHua Zhu
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> When creating a new file, it is usually necessary to communicate with the
> namenode first to obtain the location of some DataNodes as the target
> location of Blockd. At this time, when
> BlockPlacementPolicyDefault#getMaxNodesPerRack() is executed, if the number
> of replicas is very large, once it exceeds the number of all nodes in the
> cluster. The following piece of code will be executed:
> int clusterSize = clusterMap.getNumOfLeaves();
> int totalNumOfReplicas = numOfChosen + numOfReplicas;
> if (totalNumOfReplicas > clusterSize) {
> numOfReplicas -= (totalNumOfReplicas-clusterSize);
> totalNumOfReplicas = clusterSize;
> }
> Here, the calculation for numOfReplicas gets a little more complicated. It
> can be simplified like:
> numOfReplicas = clusterSize - numOfChosen
> It would be more helpful to understand it this way, while also freeing up a
> little cpu (though not a lot).
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
