[ 
https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Naganarasimha G R updated YARN-2495:
------------------------------------
    Attachment: YARN-2495_20141022.1.patch

Hi All,
Uploading a WIP patch, just to share the approach...
Completed 
* User can set labels in each NM (by setting yarn-site.xml or using script 
suggested by Allen Wittenauer)
* NM will send labels to RM via ResourceTracker API
* RM will set labels in NodeLabelManager when NM register/update labels

Pending :
* No test cases written. and may be test cases modified to resolve compilation 
issues can be done in a better way.
* As per the design Doc there was requirement to specifically either support 
distributed or Centralized but was not sure how to get it done as current 
design does not seem to be specific to central or distributed and  class was 
configured to identify NodeLabelsManager, 
* Currently i have not completely ensured that Node Labels are sent only when 
there is change in the labels got from script to the last successful updated 
labels to RM. Response of node heartbeat and node register can be made used for 
this. Yet to finish.
* Configuration has been added to validate for centralized labels. But need to 
further discuss on the approach for this.

> Allow admin specify labels in each NM (Distributed configuration)
> -----------------------------------------------------------------
>
>                 Key: YARN-2495
>                 URL: https://issues.apache.org/jira/browse/YARN-2495
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Naganarasimha G R
>         Attachments: YARN-2495_20141022.1.patch
>
>
> Target of this JIRA is to allow admin specify labels in each NM, this covers
> - User can set labels in each NM (by setting yarn-site.xml or using script 
> suggested by [~aw])
> - NM will send labels to RM via ResourceTracker API
> - RM will set labels in NodeLabelManager when NM register/update labels



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to