[
https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDFS-11514:
---------------------------------
Summary: DFSTopologyNodeImpl#chooseRandom optimizations (was: ChooseRandom
can potentially be optimized)
> DFSTopologyNodeImpl#chooseRandom optimizations
> ----------------------------------------------
>
> Key: HDFS-11514
> URL: https://issues.apache.org/jira/browse/HDFS-11514
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: namenode
> Reporter: Chen Liang
> Assignee: Chen Liang
> Attachments: HDFS-11514.001.patch, HDFS-11514.002.patch,
> HDFS-11514.003.patch
>
>
> Based on the offline discussion, one potential improvement to the
> {{chooseRandomWithStorageType}} added in HDFS-11482 is that, currently given
> a node, the method iterates all its children to sum up the number of
> candidate datanodes. Since datanode status change is much less frequent than
> block placement request. It is more efficient to get rid of this iteration
> check, by probably maintaining another disk type counter map. This JIRA
> tracks (but not limited) this optimization.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
