[
https://issues.apache.org/jira/browse/MAPREDUCE-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724649#comment-17724649
]
ASF GitHub Bot commented on MAPREDUCE-7438:
-------------------------------------------
mudit1289 opened a new pull request, #5680:
URL: https://github.com/apache/hadoop/pull/5680
ASF JIRA: https://issues.apache.org/jira/browse/MAPREDUCE-7438
Allowing config to remove untracked nodes having only selective nodeStates
Config:
yarn.resourcemanager.node-removal-untracked.node-selective-states-to-remove
If Yarn untracked removal is enabled, then this config can control what all
node states can be removed. If the untracked node is not having one of these
states, then node will skipped for removal. If this config value is set to
empty, all node states, will be eligible for removal
NodeState is an ENUM: org.apache.hadoop.yarn.api.records.NodeState
### How was this patch tested?
Adding 1 new UT in TestResourceTrackerService.java
> Support removal of only selective node states in untracked removal flow
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-7438
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7438
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Mudit Sharma
> Priority: Major
>
> Currently inactive nodes are removed from the Yarn local memory irrespective
> of which state they are in. This makes the node removal process not too much
> configurable
> After this patch: https://issues.apache.org/jira/browse/YARN-10854
> If autoscaling is enabled, lot many nodes go into DECOMMISSIONED state but
> still other states like LOST, SHUTDOWN are very less and systems might want
> them to be still visible on UI for better tracking
> The proposal is to introduce a new config, which when set, will allow only
> selective node states to be removed after going into untracked state.
> Any thoughts/suggestions/feedbacks are welcome!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
