[
https://issues.apache.org/jira/browse/YARN-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229384#comment-15229384
]
Wangda Tan commented on YARN-2694:
----------------------------------
[~zhz],
The major reason of only supporting specify node label in off-switch request
is: existing node label is actually node partition, admin can limit how much
resource that can be used by each queue in each partition. So if rack / node
level request has different partition of off-switch request, scheduler cannot
correctly calculate how much resource the app requested in each partition: all
existing logic to calculate pending resources of an app relies on off-switch
request.
This patch doesn't allow specify any label in rack / node, all rack / node
request contains label will be directly rejected. This is not correct, we fixed
this in YARN-4140 that forces all requests under the off-switch request has
same label. You can take a look at discussions on YARN-4140.
If you want rack / node specify different label, they will be available after
YARN-3409 (node constraints). Node constraints will be used to tag NMs, no more
enforcements (such as ACL, resource limtis, etc.) will be added to node
constraints.
> Ensure only single node labels specified in resource request / host, and node
> label expression only specified when resourceName=ANY
> -----------------------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-2694
> URL: https://issues.apache.org/jira/browse/YARN-2694
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: capacityscheduler, resourcemanager
> Reporter: Wangda Tan
> Assignee: Wangda Tan
> Labels: 2.6.1-candidate
> Fix For: 2.7.0, 2.6.1
>
> Attachments: YARN-2694-20141020-1.patch, YARN-2694-20141021-1.patch,
> YARN-2694-20141023-1.patch, YARN-2694-20141023-2.patch,
> YARN-2694-20141101-1.patch, YARN-2694-20141101-2.patch,
> YARN-2694-20150121-1.patch, YARN-2694-20150122-1.patch,
> YARN-2694-20150202-1.patch, YARN-2694-20150203-1.patch,
> YARN-2694-20150203-2.patch, YARN-2694-20150204-1.patch,
> YARN-2694-20150205-1.patch, YARN-2694-20150205-2.patch,
> YARN-2694-20150205-3.patch, YARN-2694-branch-2.6.1.txt
>
>
> Currently, node label expression supporting in capacity scheduler is partial
> completed. Now node label expression specified in Resource Request will only
> respected when it specified at ANY level. And a ResourceRequest/host with
> multiple node labels will make user limit, etc. computation becomes more
> tricky.
> Now we need temporarily disable them, changes include,
> - AMRMClient
> - ApplicationMasterService
> - RMAdminCLI
> - CommonNodeLabelsManager
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
