[
https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352252#comment-16352252
]
wangwj commented on YARN-7859:
------------------------------
Hi,[~yufeigu].[[email protected]]..Thank you for your reply.
Your example is roughly the same as the problems I encountered in my
cluster.
There are two and only two queues under the root, q1 and q2. q1 has many
long-running large job and occupy large
resources.Based on this,root.q1won't be scheduled for a while even there are
available resources.
So, I propose this issue...Add queue scheduling deadLine to improve this
phenomenon.The implementation in my patch is a common solution like scheduling
in disk and database.
I have see the global scheduling!
[YARN-5139|https://issues.apache.org/jira/browse/YARN-5139]....But we don’t
konw when we can use it.I think add queue scheduling deadLine is the most
efficient way.
Please give me some advices..
Thanks...
> New feature: add queue scheduling deadLine in fairScheduler.
> ------------------------------------------------------------
>
> Key: YARN-7859
> URL: https://issues.apache.org/jira/browse/YARN-7859
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: fairscheduler
> Affects Versions: 3.0.0
> Reporter: wangwj
> Assignee: wangwj
> Priority: Major
> Labels: fairscheduler, features, patch
> Fix For: 3.0.0
>
> Attachments: YARN-7859-v1.patch, log, screenshot-1.png,
> screenshot-3.png
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> As everyone knows.In FairScheduler the phenomenon of queue scheduling
> starvation often occurs when the number of cluster jobs is large.The App in
> one or more queue are pending.So I have thought a way to solve this
> problem.Add queue scheduling deadLine in fairScheduler.When a queue is not
> scheduled for FairScheduler within a specified time.We mandatory scheduler it!
> On the basis of the above, I propose this issue...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
