[ https://issues.apache.org/jira/browse/HADOOP-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HADOOP-971: --------------------------------- Fix Version/s: 0.13.0 Affects Version/s: (was: 0.11.0) 0.12.2 Status: Patch Available (was: Open) Dhruba, thanks a lot for testing my patch. > DFS Scalabilty: Improve name node performance by adding a hostname to > datanodes map > ----------------------------------------------------------------------------------- > > Key: HADOOP-971 > URL: https://issues.apache.org/jira/browse/HADOOP-971 > Project: Hadoop > Issue Type: Improvement > Components: dfs > Affects Versions: 0.12.2 > Reporter: Hairong Kuang > Assigned To: Hairong Kuang > Fix For: 0.13.0 > > Attachments: Host2NodesMap.patch > > > A name node currently maintains a datanode map which maps a storage id to a > dataNodeDescriptor. When the name node needs to get a datanodeDescriptor by > its name (hostname:port#) or by its host name, it has to iterate through the > data node set, which is very inefficent. I'd like to add an additional map > that maps a host name to an array list of DatanodeDescriptors that contains > all the data nodes running on the host. Since most of time a node runs only > one data node, the intial size of the array list is set to be 1. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.