Filed https://issues.apache.org/jira/browse/YARN-4278 for more discussion .
Thanks & Regards Rohith Sharma K S -----Original Message----- From: Steve Loughran [mailto:[email protected]] Sent: Mon, 19 Oct 2015 15:30:28 GMT To: [email protected]<mailto:[email protected]> Subject: Re: When does the RM ever send out node map updates? > On 19 Oct 2015, at 12:04, Rohith Sharma K S <[email protected]> wrote: > >>>> how does the AM determine the map of nodes. > IIUC, it is not possible now. Probably a bug which was missed till now!! > OR > Does all the applications need to know all the nodes updates in a cluster? It > could be 1000 nodes , 10K nodes. > > And how about when node label is configured.? my AM needs to know the map because it's trying to support anti-affinity in resource requests (SLIDER-82), with the plan being "ask for any node that isn't already in use by that component type"). Some people have suggested blacklisting, but that would block all the other outstanding requests for other components. The AM would be happy with a node map and then update events as things change
