Github user li-zhihui commented on the pull request:
https://github.com/apache/spark/pull/1131#issuecomment-46540777
@mridulm
for example:
2 tasks(task_x, task_y), 2 executors(host1, host2)
task_x.preferredLocations = [host2, host3, host1]
task_y.preferredLocations = [host1, host3, host4]
the task_x exist in penddingTasks array of host1, host2, host3
the task_y exist in pendinngTasks arrya of host1, host3, host4
if host1 pick up task_x & task_x is the last task of host2
then host2 can't get any host_preferred_task(and it must wait 3 seconds to
get task_y)
if host1 pick up task_y and leave task_x to host2
then both of host1 and host2 can get preferred task
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
