Craig Welch commented on YARN-2495:

[~Naganarasimha] I understand the desire to have the feature, it does seem more 
like a convenience / simplification measure than an introduction of something 
that can't be otherwise accomplished, but convenience and simplification can 
matter a great deal, so why not :-)

bq. There will be always confusion ... Do we need to "And" or "OR" 

What I'm getting at is that I think there are just too many switches and knobs 
in play once you consider the flag DECENTRALIZED_CONFIGURATION_ENABLED in 
addition to the other configuration relationships (defining the configuration 
script to do the update from nodes), I think that the act of configuring 
something to send node labels from the node manager is sufficient "intent" that 
it is the desired behavior, and the additional  
DECENTRALIZED_CONFIGURATION_ENABLED is just an extra ceiling for someone to 
bump their head against while setting this up.  wrt supporting add vs replace 
behavior, I think that as it's described now the idea is to just support 
replace form the node script, meaning that it will effectively be the only 
definition used when it is active (which is fine for many cases).  In the 
future, if there is a need for hybrid configuration of labels that can become 
an enhancement.  An option would be to use a different parameter for a script 
which will do add and remove instead of replace, and then say have it return + 
or - (for add and remove) with the label instead of a fixed set of labels for 
replacement.  From what I see above, the replacement approach, where the script 
determines the full label set, looks to be the immediate need - the other could 
be added in a compatible way later if it was needed.

> Allow admin specify labels from each NM (Distributed configuration)
> -------------------------------------------------------------------
>                 Key: YARN-2495
>                 URL: https://issues.apache.org/jira/browse/YARN-2495
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Naganarasimha G R
>         Attachments: YARN-2495.20141023-1.patch, YARN-2495.20141024-1.patch, 
> YARN-2495.20141030-1.patch, YARN-2495.20141031-1.patch, 
> YARN-2495.20141119-1.patch, YARN-2495.20141126-1.patch, 
> YARN-2495.20141204-1.patch, YARN-2495.20141208-1.patch, 
> YARN-2495_20141022.1.patch
> Target of this JIRA is to allow admin specify labels in each NM, this covers
> - User can set labels in each NM (by setting yarn-site.xml (YARN-2923) or 
> using script suggested by [~aw] (YARN-2729) )
> - NM will send labels to RM via ResourceTracker API
> - RM will set labels in NodeLabelManager when NM register/update labels

This message was sent by Atlassian JIRA

Reply via email to