[ 
https://issues.apache.org/jira/browse/TEZ-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200718#comment-14200718
 ] 

Rajesh Balamohan commented on TEZ-1742:
---------------------------------------

>>
Map_2: 0/1      Map_3: 0/1      Map_5: 0/1000   Map_7: 0/1      Reducer_3: 
0/200        Reducer_6: 0/10
>>

Job response time (without patch) : 60.996 seconds, 60.692 seconds
Job response time (with patch) : 42.953 seconds, 42.167 seconds

Patch improves job runtime performance by very good margin (Mileage would vary 
based on cluster size, number of tasks in DAG etc.).

> Improve response time of internal preemption
> --------------------------------------------
>
>                 Key: TEZ-1742
>                 URL: https://issues.apache.org/jira/browse/TEZ-1742
>             Project: Apache Tez
>          Issue Type: Task
>            Reporter: Bikas Saha
>            Assignee: Bikas Saha
>         Attachments: TEZ-1742.1.patch, TEZ-1742.2.patch, TEZ-1742.3.patch
>
>
> Tez YARN Task Scheduler currently preempts 1 running task at a time when a 
> higher priority task is waiting and there are no available resources. When a 
> large number of higher priority tasks are pending then it can take a long 
> time to preempt the required number of lower priority tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to