[ 
https://issues.apache.org/jira/browse/TEZ-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated TEZ-1742:
----------------------------
    Attachment: TEZ-1742.4.patch

Attaching patch that adds a delay between successive preemptions that allows 
the scheduler to wait for the RM to react to the preempted resources and make 
new assignments. Tests updated to account for new functionality.

Please take another pass at this. This should hopefully complete the necessary 
changes.

> Improve response time of internal preemption
> --------------------------------------------
>
>                 Key: TEZ-1742
>                 URL: https://issues.apache.org/jira/browse/TEZ-1742
>             Project: Apache Tez
>          Issue Type: Task
>            Reporter: Bikas Saha
>            Assignee: Bikas Saha
>         Attachments: TEZ-1742.1.patch, TEZ-1742.2.patch, TEZ-1742.3.patch, 
> TEZ-1742.4.patch
>
>
> Tez YARN Task Scheduler currently preempts 1 running task at a time when a 
> higher priority task is waiting and there are no available resources. When a 
> large number of higher priority tasks are pending then it can take a long 
> time to preempt the required number of lower priority tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to