Nathan Roberts updated YARN-3388:
    Attachment: YARN-3388-v0.patch

Initial patch for comments on approach. Seems to work well in basic testing on 
2.6. I don't know how this interacts with label support + userlimit which I 
think is still lacking in some cases anyway.  Hoping [~leftnoteasy] and others 
can comment.

> userlimit isn't playing well with DRF calculator
> ------------------------------------------------
>                 Key: YARN-3388
>                 URL: https://issues.apache.org/jira/browse/YARN-3388
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacityscheduler
>    Affects Versions: 2.6.0
>            Reporter: Nathan Roberts
>            Assignee: Nathan Roberts
>         Attachments: YARN-3388-v0.patch
> When there are multiple active users in a queue, it should be possible for 
> those users to make use of capacity up-to max_capacity (or close). The 
> resources should be fairly distributed among the active users in the queue. 
> This works pretty well when there is a single resource being scheduled.   
> However, when there are multiple resources the situation gets more complex 
> and the current algorithm tends to get stuck at Capacity. 
> Example illustrated in subsequent comment.

This message was sent by Atlassian JIRA

Reply via email to