[
https://issues.apache.org/jira/browse/HADOOP-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396123#comment-13396123
]
Hudson commented on HADOOP-8470:
--------------------------------
Integrated in Hadoop-Common-trunk-Commit #2367 (See
[https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2367/])
Revert r1351163 for fixing the JIRA number; it should be HADOOP-8470 but
not HADOOP-8468. (Revision 1351444)
Result = SUCCESS
szetszwo :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351444
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
*
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetworkTopologyWithNodeGroup.java
*
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
*
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/net/TestNetworkTopologyWithNodeGroup.java
> Implementation of 4-layer subclass of NetworkTopology
> (NetworkTopologyWithNodeGroup)
> ------------------------------------------------------------------------------------
>
> Key: HADOOP-8470
> URL: https://issues.apache.org/jira/browse/HADOOP-8470
> Project: Hadoop Common
> Issue Type: Sub-task
> Affects Versions: 1.0.0, 2.0.0-alpha
> Reporter: Junping Du
> Assignee: Junping Du
> Fix For: 3.0.0
>
> Attachments: HADOOP-8470-NetworkTopology-new-impl-v2.patch,
> HADOOP-8470-NetworkTopology-new-impl-v3.patch,
> HADOOP-8470-NetworkTopology-new-impl-v4.patch,
> HADOOP-8470-NetworkTopology-new-impl.patch
>
>
> To support the four-layer hierarchical topology shown in attached figure as a
> subclass of NetworkTopology, NetworkTopologyWithNodeGroup was developed along
> with unit tests. NetworkTopologyWithNodeGroup overriding the methods add,
> remove, and pseudoSortByDistance were the most relevant to support the
> four-layer topology. The method seudoSortByDistance selects the nodes to use
> for reading data and sorts the nodes in sequence of node-local,
> nodegroup-local, rack- local, rack–off. Another slightly change to
> seudoSortByDistance is to support cases of separation data node and node
> manager: if the reader cannot be found in NetworkTopology tree (formed by
> data nodes only), then it will try to sort according to reader's sibling node
> in the tree.
> The distance calculation changes the weights from 0 (local), 2 (rack- local),
> 4 (rack-off) to: 0 (local), 2 (nodegroup-local), 4 (rack-local), 6 (rack-off).
> The additional node group layer should be specified in the topology script or
> table mapping, e.g. input 10.1.1.1, output: /rack1/nodegroup1
> A subclass on InnerNode, InnerNodeWithNodeGroup, was also needed to support
> NetworkTopologyWithNodeGroup.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
