Sunil G commented on YARN-2495:

Hi All.

I have a doubt here, 

1. In distributed configuration, each NM can specify label in 
register/heartbeat(update). I am not sure check for "Valid Label" to happen in 
RM or NM. As per the current design, it looks like all valid checks are 
happening at RM. 
If any such node label is invalid as per RM, then how this will be reported 
back to NM? Error Handling?

2. If possible to change label at run time from NM, i think same existing 
interfaces are used (heartbeat). Do you feel this check will happen may be more 
frequent in RM than in a Centralized configuration? In centralized config, some 
command will be fired by admin to change labels. This may not be frequent. But 
imagine a 1000 node cluster, and then with changing labels per heartbeat, will 
this be a bottleneck?

> Allow admin specify labels in each NM (Distributed configuration)
> -----------------------------------------------------------------
>                 Key: YARN-2495
>                 URL: https://issues.apache.org/jira/browse/YARN-2495
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Naganarasimha G R
> Target of this JIRA is to allow admin specify labels in each NM, this covers
> - User can set labels in each NM (by setting yarn-site.xml or using script 
> suggested by [~aw])
> - NM will send labels to RM via ResourceTracker API
> - RM will set labels in NodeLabelManager when NM register/update labels

This message was sent by Atlassian JIRA

Reply via email to