Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/8007#issuecomment-137538472
re: the new race, I think it's fine to do it as a separate change. It's
separate enough from the code being changed here that trying to tack both
changes here would be confusing.
I'm a little conflicted about whether to wait for that to be changed before
we can merge this; on one hand, this change introduces that race. On the other,
the failure mode the race introduces is not much different from the existing
one - when executors are preempted, tasks will fail and eventually fail the
app. It might make it slightly worse, but we're already in a bad spot today,
and this change is an improvement in the right direction.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
