Github user kayousterhout commented on the pull request:
https://github.com/apache/spark/pull/8760#issuecomment-161132665
I had one other idea here: for blacklisted executors / hosts, we *could*
periodically run a speculative copy of a task there. If the task succeeds, we
can un-blacklist the executor, and if the task fails, we haven't lost anything,
because the task is just a speculative copy, so there's another copy of the
task running elsewhere. That would allow us to more aggressively re-try the
executor, without sacrificing performance of any running jobs.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
