Github user nezihyigitbasi commented on the pull request:
https://github.com/apache/spark/pull/11241#issuecomment-186444001
@andrewor14 thanks for taking a look. We can introduce a global failure
threshold to break out, but do we really want that global threshold to be a
constant? Because it's possible that from run to run with the same settings one
run can succeed and the other one can fail (hit the threshold) depending on the
order of the live/removed executors in the location list (tl;dr from a user's
point of view a job can arbitrarily fail from run to run).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
