[
https://issues.apache.org/jira/browse/TEZ-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated TEZ-3270:
-------------------------
Summary: Scheduling policy in fair routing (was: Scheduling policy in Fair
routing)
> Scheduling policy in fair routing
> ---------------------------------
>
> Key: TEZ-3270
> URL: https://issues.apache.org/jira/browse/TEZ-3270
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Ming Ma
>
> The scheduling considers the following factors:
> * Destination tasks’ dependency on source tasks defined by the routing policy.
> * Data locality.
> In the regular scatterÂgather routing policy, each destination task depends
> on all source tasks. If
> slowstart is configured to be less than 1.0, destination tasks can be started
> as long as a portion
> of destination tasks have completed and can fetch data from all those
> completed source tasks.
> In fair routing, a destination task might depend on only a subset of source
> tasks thus there is no
> point of scheduling a destination task if none of the source tasks it depends
> on have completed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
