Naganarasimha G R commented on YARN-2495:

Hi [~aw] ,
bq. I don't think you understand the use case at all. In fact, it's clear you 
need to re-read the sample script. It does not get updated with every new JDK. 
It's smart enough to update the label regardless of the JDK that is installed...
I meant like script needs to be modified for new label set for example, 
currently admin as configured for JDK Labels and further if he wanted to add 
label related to some native lib version, *As admin will knows all the valid 
native lib versions in the system(or can be automated to get this list) while 
modifying the script he will be able to configure the valid labels too*.

bq. which means the only friction to operations is point is going to be 
updating this 'valid label list' on the RM.
Seems like maintenance wise it might become difficult  for example, once the 
valid JDK labels are loaded admins will forget about this feature and later on 
based on the req, some other admin/person might update the JDK and he might not 
be aware about such a script exists which updates the labels based on JDK or 
native libs version. So he might miss to update the valid labels and that node 
might not be useful or wrong labels will will be tagged to it as new labels are 
not updated.

So i feel Allen's scenario needs to be addressed. As [~Wangda] suggested i feel 
centralized Label validation can be made configurable. Please provide opinion 
on this.

> Allow admin specify labels in each NM (Distributed configuration)
> -----------------------------------------------------------------
>                 Key: YARN-2495
>                 URL: https://issues.apache.org/jira/browse/YARN-2495
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Naganarasimha G R
> Target of this JIRA is to allow admin specify labels in each NM, this covers
> - User can set labels in each NM (by setting yarn-site.xml or using script 
> suggested by [~aw])
> - NM will send labels to RM via ResourceTracker API
> - RM will set labels in NodeLabelManager when NM register/update labels

This message was sent by Atlassian JIRA

Reply via email to