[ 
https://issues.apache.org/jira/browse/YARN-6156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15867531#comment-15867531
 ] 

Hudson commented on YARN-6156:
------------------------------

FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11254 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/11254/])
YARN-6156. AM blacklisting to consider node label partition (Bibin A 
(varunsaxena: rev b7613e0f406fb2b9bd5b1b3c79658e801f63c587)
* (edit) 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
* (edit) 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* (edit) 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMServerUtils.java
* (edit) 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/nodelabels/RMNodeLabelsManager.java
* (edit) 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacitySchedulerNodeLabelUpdate.java


> AM blacklisting to consider node label partition
> ------------------------------------------------
>
>                 Key: YARN-6156
>                 URL: https://issues.apache.org/jira/browse/YARN-6156
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Bibin A Chundatt
>            Assignee: Bibin A Chundatt
>             Fix For: 2.9.0, 3.0.0-alpha3
>
>         Attachments: YARN-6156.0001.patch, YARN-6156.0002.patch, 
> YARN-6156.0003.patch, YARN-6156.0004.patch, YARN-6156.0005.patch, 
> YARN-6156.0006.patch
>
>
> As per the current implementation for AM blacklisting, disabling is based on 
> complete cluster resource.
> Incase of partitioned cluster though, nodes applicable for AM labels only 
> should be considered as total nodes.
> Additionally for unmanaged AM as AM blacklisting is not done as AM is not 
> launched by RM, it is equivalent to AM blacklisting being disabled for this 
> app. Hence we do not need to create a SimpleBlacklistManager object in 
> RMAppImpl#createNewAttempt. 
> We can create DisabledBlacklistManager object instead.
> {code}
>     BlacklistManager currentAMBlacklist;
>     if (currentAttempt != null) {
>       currentAMBlacklist = currentAttempt.getAMBlacklist();
>     } else {
>       if (amBlacklistingEnabled) {
>         currentAMBlacklist = new SimpleBlacklistManager(
>             scheduler.getNumClusterNodes(), blacklistDisableThreshold);
>       } else {
>         currentAMBlacklist = new DisabledBlacklistManager();
>       }
>     }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to