[
https://issues.apache.org/jira/browse/YARN-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151863#comment-17151863
]
Cyrus Jackson commented on YARN-10335:
--------------------------------------
Thanks [~bibinchundatt] for your inputs. I have worked on the working patch
with the changes. Please give your thoughts on the approach.
The current approach is to have a new NodeHealthDetail which holds the
additional information such as SSD, HDD, SKU... etc. The overallScore is
generated based on these values from the NodeHealthCheckerService. This is then
stored to RmNodeImpl. The overallScore can be used for scheduling nodes on the
RM side.
NodeHealthService is added to make the NodeHealthCheckerService pluggable to
support custom implementations.
> Improve scheduling of containers based on node health
> -----------------------------------------------------
>
> Key: YARN-10335
> URL: https://issues.apache.org/jira/browse/YARN-10335
> Project: Hadoop YARN
> Issue Type: Improvement
> Reporter: Bibin Chundatt
> Assignee: Cyrus Jackson
> Priority: Major
> Attachments: YARN-10335.001.patch
>
>
> YARN-7494 supports providing interface to choose nodeset for scheduler
> allocation.
> We could leverage the same to support allocation of containers based on node
> health value send from nodemanagers
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
