[
https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335233#comment-16335233
]
Naganarasimha G R commented on YARN-6858:
-----------------------------------------
Thanks [~weiweiyagn666], for your views.
{quote}I am proposing we don't add such a central node attribute manager,
instead like I commented in YARN-7031, can we just use the distributed manner?
{quote}
Distributed Node Labels was always in the scope of YARN-3409 and we never
missed it as we had already taken care for partition labels and anyway
Distributed manner made more sense for attributes and we would have never
missed it. But saying that we would require {{*NodeAttributeManager* }}for the
following:
# There has to be some place which maps all the attributes to a node. And
scheduler is able to fetch the nodes for a given label and decide upon
placements.
# Attribute constraint specification in the resource request needs to be
validated against the existing labels. If not even for a typo error requests
can get queued
# UI and REST to provide the attribute information would require current
state of the attribute mapping in the cluster.
# We are supporting *type* of Attribute. So we cannot afford in case of
Distributed Node attributes, different node sending different types for the
same label.
Hence we cannot completely avoid centralized AttributeManager but definitely we
can see how to avoid storing in case of Distributed Node Attributes.
Further i have attached WIP patch. Will update more robust patch shortly.
> Attribute Manager to store and provide the attributes in RM
> -----------------------------------------------------------
>
> Key: YARN-6858
> URL: https://issues.apache.org/jira/browse/YARN-6858
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: api, capacityscheduler, client
> Reporter: Naganarasimha G R
> Assignee: Naganarasimha G R
> Priority: Major
> Attachments: YARN-6858-YARN-3409.001.patch
>
>
> Similar to CommonNodeLabelsManager we need to have a centralized manager for
> Node Attributes too.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
