Ming Ma created TEZ-3270:
----------------------------
Summary: Scheduling policy in Fair routing
Key: TEZ-3270
URL: https://issues.apache.org/jira/browse/TEZ-3270
Project: Apache Tez
Issue Type: Sub-task
Reporter: Ming Ma
The scheduling considers the following factors:
* Destination tasks’ dependency on source tasks defined by the routing policy.
* Data locality.
In the regular scatterÂgather routing policy, each destination task depends on
all source tasks. If
slowstart is configured to be less than 1.0, destination tasks can be started
as long as a portion
of destination tasks have completed and can fetch data from all those completed
source tasks.
In fair routing, a destination task might depend on only a subset of source
tasks thus there is no
point of scheduling a destination task if none of the source tasks it depends
on have completed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
