[
https://issues.apache.org/jira/browse/TEZ-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-1742:
----------------------------
Attachment: TEZ-1742.4.patch
Attaching patch that adds a delay between successive preemptions that allows
the scheduler to wait for the RM to react to the preempted resources and make
new assignments. Tests updated to account for new functionality.
Please take another pass at this. This should hopefully complete the necessary
changes.
> Improve response time of internal preemption
> --------------------------------------------
>
> Key: TEZ-1742
> URL: https://issues.apache.org/jira/browse/TEZ-1742
> Project: Apache Tez
> Issue Type: Task
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Attachments: TEZ-1742.1.patch, TEZ-1742.2.patch, TEZ-1742.3.patch,
> TEZ-1742.4.patch
>
>
> Tez YARN Task Scheduler currently preempts 1 running task at a time when a
> higher priority task is waiting and there are no available resources. When a
> large number of higher priority tasks are pending then it can take a long
> time to preempt the required number of lower priority tasks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)