[ https://issues.apache.org/jira/browse/YARN-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095060#comment-15095060 ]
Karthik Kambatla commented on YARN-3446: ---------------------------------------- Patch looks good, but for one minor comment: can we rename {{AbstractYarnScheduler#getBlackListNodeIds}} to {{addBlacklisedNodeIdsToList}} to capture the behavior here of adding the nodeIds to the list that is passed. Also, given the method is used by all schedulers, we might want to add a javadoc briefly explaining what it does. > FairScheduler HeadRoom calculation should exclude nodes in the blacklist. > ------------------------------------------------------------------------- > > Key: YARN-3446 > URL: https://issues.apache.org/jira/browse/YARN-3446 > Project: Hadoop YARN > Issue Type: Bug > Components: fairscheduler > Reporter: zhihai xu > Assignee: zhihai xu > Attachments: YARN-3446.000.patch, YARN-3446.001.patch, > YARN-3446.002.patch, YARN-3446.003.patch, YARN-3446.004.patch > > > FairScheduler HeadRoom calculation should exclude nodes in the blacklist. > MRAppMaster does not preempt the reducers because for Reducer preemption > calculation, headRoom is considering blacklisted nodes. This makes jobs to > hang forever(ResourceManager does not assign any new containers on > blacklisted nodes but availableResource AM get from RM includes blacklisted > nodes available resource). > This issue is similar as YARN-1680 which is for Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.3.4#6332)