[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335233#comment-16335233 ]
Naganarasimha G R commented on YARN-6858: ----------------------------------------- Thanks [~weiweiyagn666], for your views. {quote}I am proposing we don't add such a central node attribute manager, instead like I commented in YARN-7031, can we just use the distributed manner? {quote} Distributed Node Labels was always in the scope of YARN-3409 and we never missed it as we had already taken care for partition labels and anyway Distributed manner made more sense for attributes and we would have never missed it. But saying that we would require {{*NodeAttributeManager* }}for the following: # There has to be some place which maps all the attributes to a node. And scheduler is able to fetch the nodes for a given label and decide upon placements. # Attribute constraint specification in the resource request needs to be validated against the existing labels. If not even for a typo error requests can get queued # UI and REST to provide the attribute information would require current state of the attribute mapping in the cluster. # We are supporting *type* of Attribute. So we cannot afford in case of Distributed Node attributes, different node sending different types for the same label. Hence we cannot completely avoid centralized AttributeManager but definitely we can see how to avoid storing in case of Distributed Node Attributes. Further i have attached WIP patch. Will update more robust patch shortly. > Attribute Manager to store and provide the attributes in RM > ----------------------------------------------------------- > > Key: YARN-6858 > URL: https://issues.apache.org/jira/browse/YARN-6858 > Project: Hadoop YARN > Issue Type: Sub-task > Components: api, capacityscheduler, client > Reporter: Naganarasimha G R > Assignee: Naganarasimha G R > Priority: Major > Attachments: YARN-6858-YARN-3409.001.patch > > > Similar to CommonNodeLabelsManager we need to have a centralized manager for > Node Attributes too. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org