Github user steveloughran commented on the pull request:
https://github.com/apache/spark/pull/7786#issuecomment-162965678
Jerry: do you know when YARN visits this decisions about having things
pre-emptible? That is: if you are given a warning dos that mean the container
will go any time in the next 60s? hour? As the longer the window is, the less
useful it is avoiding scheduling work âyou lose too much.
Or is this really a warning that YARN wants the container back and that you
should just release it gracefully? If that's the case, then graceful shutdown
of work is exactly what's needed
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
