[
https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Naganarasimha G R updated YARN-2495:
------------------------------------
Attachment: YARN-2495_20141022.1.patch
Hi All,
Uploading a WIP patch, just to share the approach...
Completed
* User can set labels in each NM (by setting yarn-site.xml or using script
suggested by Allen Wittenauer)
* NM will send labels to RM via ResourceTracker API
* RM will set labels in NodeLabelManager when NM register/update labels
Pending :
* No test cases written. and may be test cases modified to resolve compilation
issues can be done in a better way.
* As per the design Doc there was requirement to specifically either support
distributed or Centralized but was not sure how to get it done as current
design does not seem to be specific to central or distributed and class was
configured to identify NodeLabelsManager,
* Currently i have not completely ensured that Node Labels are sent only when
there is change in the labels got from script to the last successful updated
labels to RM. Response of node heartbeat and node register can be made used for
this. Yet to finish.
* Configuration has been added to validate for centralized labels. But need to
further discuss on the approach for this.
> Allow admin specify labels in each NM (Distributed configuration)
> -----------------------------------------------------------------
>
> Key: YARN-2495
> URL: https://issues.apache.org/jira/browse/YARN-2495
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: resourcemanager
> Reporter: Wangda Tan
> Assignee: Naganarasimha G R
> Attachments: YARN-2495_20141022.1.patch
>
>
> Target of this JIRA is to allow admin specify labels in each NM, this covers
> - User can set labels in each NM (by setting yarn-site.xml or using script
> suggested by [~aw])
> - NM will send labels to RM via ResourceTracker API
> - RM will set labels in NodeLabelManager when NM register/update labels
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
