[
https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303099#comment-16303099
]
Weiwei Yang commented on YARN-7612:
-----------------------------------
Hi [~asuresh]
Thanks for the quick response and all the details.
Except for the 3 ways you mentioned above, there is a 4th case, like following
example,
I want to place allocations (with tag "*myalloc*") to a node that doesn't have
"*spark*" allocations. Here is the request,
{noformat}
SchedulingRequest
- numAllocations: 1
- allocationTags: myalloc
- placementConstraint: {target: allocation-tag NOT_IN “spark”, scope: host}
{noformat}
My concern is when request involves multiple tags, some other tags might be
changing at any time. So only if the tags are only considered in the placement
phase, there might be inconsistent problems. I think we need an extra check in
the scheduling phase, to make sure the actual allocation respects the actual
state of tags. I will read YARN-7613 and raise a JIRA to track this issue, if
you think it is a valid concern.
Thanks.
> Add Processor Framework for Rich Placement Constraints
> ------------------------------------------------------
>
> Key: YARN-7612
> URL: https://issues.apache.org/jira/browse/YARN-7612
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Arun Suresh
> Assignee: Arun Suresh
> Fix For: 3.1.0
>
> Attachments: YARN-7612-YARN-6592.001.patch,
> YARN-7612-YARN-6592.002.patch, YARN-7612-YARN-6592.003.patch,
> YARN-7612-YARN-6592.004.patch, YARN-7612-YARN-6592.005.patch,
> YARN-7612-YARN-6592.006.patch, YARN-7612-YARN-6592.007.patch,
> YARN-7612-YARN-6592.008.patch, YARN-7612-YARN-6592.009.patch,
> YARN-7612-YARN-6592.010.patch, YARN-7612-YARN-6592.011.patch,
> YARN-7612-YARN-6592.012.patch, YARN-7612-v2.wip.patch, YARN-7612.wip.patch
>
>
> This introduces a Placement Processor and a Planning algorithm framework to
> handle placement constraints and scheduling requests from an app and places
> them on nodes.
> The actual planning algorithm(s) will be handled in a YARN-7613.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
