[
https://issues.apache.org/jira/browse/YARN-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tomas F. Pena updated YARN-4319:
--------------------------------
Environment:
Hadoop 2.7.1
Amazon Linux AMI 2015.09 (HVM)
java version "1.7.0_85"
OpenJDK Runtime Environment (amzn-2.6.1.3.61.amzn1-x86_64 u85-b01)
OpenJDK 64-Bit Server VM (build 24.85-b03, mixed mode)
was:
Hadoop 7.1
java version "1.7.0_85"
OpenJDK Runtime Environment (amzn-2.6.1.3.61.amzn1-x86_64 u85-b01)
OpenJDK 64-Bit Server VM (build 24.85-b03, mixed mode)
> Nodemanagers are decommissioned when the the list of included hosts is not
> empty
> --------------------------------------------------------------------------------
>
> Key: YARN-4319
> URL: https://issues.apache.org/jira/browse/YARN-4319
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Affects Versions: 2.7.1
> Environment: Hadoop 2.7.1
> Amazon Linux AMI 2015.09 (HVM)
> java version "1.7.0_85"
> OpenJDK Runtime Environment (amzn-2.6.1.3.61.amzn1-x86_64 u85-b01)
> OpenJDK 64-Bit Server VM (build 24.85-b03, mixed mode)
> Reporter: Tomas F. Pena
> Labels: newbie
>
> When the file indicated in yarn.resourcemanager.nodes.include-path is nor
> empty, the resource manager decommision all the nodemanagers
> {{2015-10-29 18:51:51,900 INFO org.apache.hadoop.util.HostsFileReader:
> Setting the includes file to /opt/yarn/hadoop/etc/hadoop/yarn.include}}
> {{2015-10-29 18:51:51,900 INFO org.apache.hadoop.util.HostsFileReader:
> Setting the excludes file to /opt/yarn/hadoop/etc/hadoop/yarn.exclude}}
> {{2015-10-29 18:51:51,900 INFO org.apache.hadoop.util.HostsFileReader:
> Refreshing hosts (include/exclude) list}}
> {{2015-10-29 18:51:51,900 INFO org.apache.hadoop.util.HostsFileReader: Adding
> a to the list of included hosts from
> /opt/yarn/hadoop/etc/hadoop/yarn.include}}
> {{2015-10-2918:51:51,901 INFO
> org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdmaster
> IP=10.0.0.10 OPERATION=refreshNodes TARGET=AdminService RESULT=SUCCESS}}
> {{2015-10-29 18:51:51,901 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Deactivating
> Node ip-10-0-0-106.ec2.internal:33747 as it is now DECOMMISSIONED}}
> {{2015-10-29 18:51:51,901 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl:
> ip-10-0-0-106.ec2.internal:33747 Node Transitioned from RUNNING to
> DECOMMISSIONED}}
> {{2015-10-29 18:51:51,901 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Deactivating
> Node ip-10-0-0-105.ec2.internal:57257 as it is now DECOMMISSIONED}}
> {{2015-10-29 18:51:51,901 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl:
> ip-10-0-0-105.ec2.internal:57257 Node Transitioned from RUNNING to
> DECOMMISSIONED}}
> {{2015-10-29 18:51:51,901 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Deactivating
> Node ip-10-0-0-104.ec2.internal:48645 as it is now DECOMMISSIONED}}
> {{2015-10-29 18:51:51,901 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl:
> ip-10-0-0-104.ec2.internal:48645 Node Transitioned from RUNNING to
> DECOMMISSIONED}}
> {{2015-10-29 18:51:51,901 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Deactivating
> Node ip-10-0-0-107.ec2.internal:33115 as it is now DECOMMISSIONED}}
> {{2015-10-29 18:51:51,901 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl:
> ip-10-0-0-107.ec2.internal:33115 Node Transitioned from RUNNING to
> DECOMMISSIONED}}
> {{2015-10-29 18:51:51,902 INFO
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler:
> Removed node ip-10-0-0-106.ec2.internal:33747 clusterResource: <memory:9216,
> vCores:3>}}
> {{2015-10-29 18:51:51,902 INFO
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler:
> Removed node ip-10-0-0-105.ec2.internal:57257 clusterResource: <memory:6144,
> vCores:2>}}
> {{2015-10-29 18:51:51,902 INFO
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler:
> Removed node ip-10-0-0-104.ec2.internal:48645 clusterResource: <memory:3072,
> vCores:1>}}
> {{2015-10-29 18:51:51,902 INFO
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler:
> Removed node ip-10-0-0-107.ec2.internal:33115 clusterResource: <memory:0,
> vCores:0>}}
> {{2015-10-29 18:51:52,006 INFO
> org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService:
> Disallowed NodeManager nodeId: ip-10-0-0-105.ec2.internal:57257 hostname:
> ip-10-0-0-105.ec2.internal}}
> {{2015-10-29 18:51:52,683 INFO
> org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService:
> Disallowed NodeManager nodeId: ip-10-0-0-106.ec2.internal:33747 hostname:
> ip-10-0-0-106.ec2.internal}}
> {{2015-10-29 18:51:52,734 INFO
> org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService:
> Disallowed NodeManager nodeId: ip-10-0-0-107.ec2.internal:33115 hostname:
> ip-10-0-0-107.ec2.internal}}
> {{2015-10-29 18:51:52,891 INFO
> org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService:
> Disallowed NodeManager nodeId: ip-10-0-0-104.ec2.internal:48645 hostname:
> ip-10-0-0-104.ec2.internal}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
