[
https://issues.apache.org/jira/browse/HADOOP-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du updated HADOOP-8817:
-------------------------------
Description:
HADOOP-8468 propose network topology changes for running on virtualized
infrastructure, which includes:
1. Add "NodeGroup" layer in new NetworkTopology (also known as
NetworkTopologyWithNodeGroup): HADOOP-8469, HADOOP-8470
2. Update Replica Placement/Removal Policy to reflect new topology layer:
HDFS-3498, HDFS-3601
3. Update balancer policy:HDFS-3495
4. Update Task Scheduling Policy to reflect new topology layer and support the
case that compute nodes (NodeManager or TaskTracker) and data nodes are
separated into different VMs, but still benefit from physical host locality:
YARN-18, YARN-19.
This JIRA will address the backport work on branch-1 which will be divided into
4 issues/patches in related jira issues.
was:
HADOOP-8468 propose network topology changes for running on virtualized
infrastructure, which includes:
1. Add "NodeGroup" layer in new NetworkTopology (also known as
NetworkTopologyWithNodeGroup): HADOOP-8469, HADOOP-8470
2. Update Replica Placement/Removal Policy to reflect new topology layer:
HDFS-3498, HDFS-3601
3. Update balancer policy:HDFS-3495
4. Update Task Scheduling Policy to reflect new topology layer and support the
case that compute nodes (NodeManager or TaskTracker) and data nodes are
separated into different VMs, but still benefit from physical host locality:
YARN-18, YARN-19.
This JIRA will address the backport work which will be divided into 4
issues/patches in related jiras.
> Backport Network Topology Extension for Virtualization (HADOOP-8468) to
> branch-1
> --------------------------------------------------------------------------------
>
> Key: HADOOP-8817
> URL: https://issues.apache.org/jira/browse/HADOOP-8817
> Project: Hadoop Common
> Issue Type: Sub-task
> Affects Versions: 1.0.0
> Reporter: Junping Du
> Assignee: Junping Du
> Labels: features
>
> HADOOP-8468 propose network topology changes for running on virtualized
> infrastructure, which includes:
> 1. Add "NodeGroup" layer in new NetworkTopology (also known as
> NetworkTopologyWithNodeGroup): HADOOP-8469, HADOOP-8470
> 2. Update Replica Placement/Removal Policy to reflect new topology layer:
> HDFS-3498, HDFS-3601
> 3. Update balancer policy:HDFS-3495
> 4. Update Task Scheduling Policy to reflect new topology layer and support
> the case that compute nodes (NodeManager or TaskTracker) and data nodes are
> separated into different VMs, but still benefit from physical host locality:
> YARN-18, YARN-19.
> This JIRA will address the backport work on branch-1 which will be divided
> into 4 issues/patches in related jira issues.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
