[
https://issues.apache.org/jira/browse/YARN-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291977#comment-16291977
]
Konstantinos Karanasos commented on YARN-7457:
----------------------------------------------
Hi [~leftnoteasy], to make sure we are on the same page:
* Will applications be able to specify delays both in terms of missed
opportunities and time? Or you are thinking of ditching the missed
opportunities option?
* New apps will be using the delayed-or constraint from YARN-6592, right?
* With the string to string map, you are suggesting to add something like
"delay_to_rack" -> "10 sec" as a hint? If these are legacy apps, they will
still have to be modified to use this new hint. But I understand they will not
have to switch to SchedulingRequests. That said, do you expect this to get all
the way to the scheduler, or at some point to automatically translate these to
SchedulingRequests? I think it will get messy to have two code paths for that.
> Delay scheduling should be an individual policy instead of part of scheduler
> implementation
> -------------------------------------------------------------------------------------------
>
> Key: YARN-7457
> URL: https://issues.apache.org/jira/browse/YARN-7457
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Wangda Tan
> Assignee: Tao Yang
>
> Currently, different schedulers have slightly different delay scheduling
> implementations. Ideally we should make delay scheduling independent from
> scheduler implementation. Benefits of doing this:
> 1) Applications can choose which delay scheduling policy to use, it could be
> time-based / missed-opportunistic-based or whatever new delay scheduling
> policy supported by the cluster. Now it is global config of scheduler.
> 2) Make scheduler implementations simpler and reusable.
> h2. {color:red}Running design doc:
> https://docs.google.com/document/d/1rY-CJPLbGk3Xj_8sxre61y2YkHJFK8oqKOshro1ZY3A/edit#heading=h.xnzvh9nn283a{color}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
