Weiwei Yang created YARN-8013:
---------------------------------
Summary: Support app-tag namespace for allocation tags
Key: YARN-8013
URL: https://issues.apache.org/jira/browse/YARN-8013
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Weiwei Yang
Assignee: Weiwei Yang
YARN-1461 adds *Application Tag* concept to Yarn applications, user is able to
annotate application with multiple tags to classify apps. We can leverage this
to represent a namespace for a certain group of apps. So instead of calling
*app-label*, propose to call it *app-tag*.
A typical use case is,
There are a lot of TF jobs running on Yarn, and some of them are consuming
resources heavily. So we want to limit number of PS on each node for such BIG
players but ignore those SMALL ones. To achieve this, we can do following steps:
# Add application tag "big-tf" to these big TF jobs
# For each PS request, we add "ps" source tag and map it to constraint "notin,
node, tensorflow/ps" or "cardinality, node, tensorflow/ps, 0, 2" for finer
grained controls.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
