Naganarasimha G R updated YARN-2923:
    Attachment: YARN-2923.20150404-1.patch

Rebasing the patch based on changes in yarn-2729 
bq. BTW, would the labels in RM persist some somewhere to handle RM restart and 
how about the failover in HA case then?  Would the labels are reported to both 
RMs or there is a shared label store (or in the shared RM state store)?
Well in case of distributed configuraton, Every time NM Registers we are 
sending the Labels, so on restart or HA it gets automatically handled and we 
are not persisting to a store .

bq. BTW, seems to me it is not a good idea to periodically check the 
configuration file. Why not monitor the configuration file by some file watcher 
instead? Furthermore, HADOOP-7001 defines an API to reload the configuration 
without restart. Would it possible to integrate HADOOP-7001 with your jira?
Thanks for the feed back, had a look at the watcher API, generally changes in 
the file/ directory is identified internally by polling mechanism so i feel its 
almost as the same approach as we take and it would involve additional effort 
of finding the path to the yarn-site.xml. and wrt  HADOOP-7001, there too, to 
find whether the configuration is changed or not they do not use watchers and 
they too do {{new Configuration}}, and we do not have multiple configurations 
and hence felt current interface we have is simpler and lighter but i am still 
open for modifications if any precise benefit i can see and also would like to 
get some opinion on this from [~wangda] too 

> Support configuration based NodeLabelsProvider Service in Distributed Node 
> Label Configuration Setup 
> -----------------------------------------------------------------------------------------------------
>                 Key: YARN-2923
>                 URL: https://issues.apache.org/jira/browse/YARN-2923
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager
>            Reporter: Naganarasimha G R
>            Assignee: Naganarasimha G R
>             Fix For: 2.8.0
>         Attachments: YARN-2923.20141204-1.patch, YARN-2923.20141210-1.patch, 
> YARN-2923.20150328-1.patch, YARN-2923.20150404-1.patch
> As part of Distributed Node Labels configuration we need to support Node 
> labels to be configured in Yarn-site.xml. And on modification of Node Labels 
> configuration in yarn-site.xml, NM should be able to get modified Node labels 
> from this NodeLabelsprovider service without NM restart

This message was sent by Atlassian JIRA

Reply via email to