[
https://issues.apache.org/jira/browse/YARN-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wangda Tan updated YARN-3356:
-----------------------------
Description:
According to design doc attached in YARN-3214, we need implement following
logic in CapacityScheduler:
1) When allocate a resource request with no node-label specified, it should get
preferentially allocated to node without labels.
2) When there're some available resource in a node with label, they can be used
by applications with following order:
- Applications under queues which can access the label and ask for same labeled
resource.
- Applications under queues which can access the label and ask for non-labeled
resource.
- Applications under queues cannot access the label and ask for non-labeled
resource.
3) Expose necessary information that can be used by preemption policy to make
preemption decisions.
was:
Simliar to YARN-3099, Capacity Scheduler's LeafQueue.User/FiCaSchedulerApp
should use ResourceRequest to track resource-usage/pending by label for better
resource tracking and preemption.
And also, when application's pending resource changed (container allocated, app
completed, moved, etc.), we need update ResourceUsage of queue hierarchies.
> Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track
> used-resources-by-label.
> ----------------------------------------------------------------------------------------------
>
> Key: YARN-3356
> URL: https://issues.apache.org/jira/browse/YARN-3356
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: capacityscheduler, resourcemanager
> Reporter: Wangda Tan
> Assignee: Wangda Tan
> Attachments: YARN-3356.1.patch
>
>
> According to design doc attached in YARN-3214, we need implement following
> logic in CapacityScheduler:
> 1) When allocate a resource request with no node-label specified, it should
> get preferentially allocated to node without labels.
> 2) When there're some available resource in a node with label, they can be
> used by applications with following order:
> - Applications under queues which can access the label and ask for same
> labeled resource.
> - Applications under queues which can access the label and ask for
> non-labeled resource.
> - Applications under queues cannot access the label and ask for non-labeled
> resource.
> 3) Expose necessary information that can be used by preemption policy to make
> preemption decisions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
