[
https://issues.apache.org/jira/browse/TEZ-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377656#comment-16377656
]
Jonathan Eagles commented on TEZ-3897:
--------------------------------------
This patch adds preemption to the scheduler. Priority based preemption alone
was overly aggressive in preempting tasks that had low priority but were
unrelated. This patch adds DAG aware preemption to preempt only true hangs
based on priority and ancestry.
> Tez Local Mode hang for vertices with broadcast input
> -----------------------------------------------------
>
> Key: TEZ-3897
> URL: https://issues.apache.org/jira/browse/TEZ-3897
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Jonathan Eagles
> Assignee: Jonathan Eagles
> Priority: Major
>
> Broadcast edges are not taken into consideration for slow-start edges so
> downstream tasks in local mode can start before upstream tasks. Without
> preemption in the scheduler, there will be a hang.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
