[
https://issues.apache.org/jira/browse/YARN-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572303#comment-16572303
]
Yufei Gu commented on YARN-6636:
--------------------------------
There are multiple ways to approach node labeling in Fair Scheduler. The
community doesn't have the consensus. The way YARN-2497 took heavily involves
queue management or fair share calculations. Whether node labeling want to
affect queue management is decided by whether we want fairness on the node
labeling. Node labeling partitions the cluster resources. My take is we
generally still need fairness on each partition, which is materialized by
queue, fair share. However, some particular cases only require node labeling to
act like data locality which doesn't need fairness.
> Fair Scheduler: respect node labels at resource request level
> -------------------------------------------------------------
>
> Key: YARN-6636
> URL: https://issues.apache.org/jira/browse/YARN-6636
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: fairscheduler
> Reporter: Ashwin Shankar
> Assignee: Ashwin Shankar
> Priority: Major
>
> This ticket is to track changes to fair scheduler to respect node labels at
> resource request level. When the client sets labels at resource request
> level, the scheduler must schedule those containers only on those nodes with
> that label.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
