Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/892#issuecomment-45361221
Commented on the code -- I don't think a wait time in TaskSetManager makes
sense because it will apply even to TaskSets much later in the application, so
you might get this 3 second latency added to every job. IMO let's just leave
this patch at the solution above where we enqueue stuff for missing hosts and
later remove tasks from pendingTasksWithNoPrefs if those hosts come back. Then
we can have another JIRA that separates pendingTasksWithNoPrefs that really
have no prefs from the ones that have preferred hosts that are missing, and
enforces the delay for those.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
