Github user jerryshao commented on the pull request:
https://github.com/apache/spark/pull/7786#issuecomment-163069474
@steveloughran , by default Yarn will preempt the container 15 seconds
after the warning. Yarn RM gives the warning to AM depends on the cluster usage
at that time, it will be changed time to time, once the preemption list is
changed, this executor could be rescheduled again.
Also it could not be said that this preempted container will definitely be
reclaimed by Yarn, Yarn will change the decision time to time, so using the old
decision to release the containers may not be a good idea.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
