Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/8737#issuecomment-142156005
Also, there might be an issue with this patch; `ExecutorAllocationManager`
keeps things like `executorsPendingToRemove`, which may be stale after the AM
goes down. If you're unlucky enough, the new AM will not get rid of those
particular executors, and now you're stuck with them forever, since the driver
thinks it already asked for them to be killed.
So there's more state in the driver that needs to either be reset or
communicated to the new AM.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
