GitHub user SaintBacchus opened a pull request:
https://github.com/apache/spark/pull/3771
[SPARK-4929] Bug fix: fix the yarn-client code to support HA
Nowadays, yarn-client will exit directly when the HA change happens no
matter how many times the am should retry.
The reason may be that the default final status only considerred the
sys.exit, and the yarn-client HA cann't benefit from this.
So we should distinct the default final status between client and cluster,
because the SUCCEEDED status may cause the HA failed in client mode and
UNDEFINED may cause the error reporter in cluster when using sys.exit.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/SaintBacchus/spark YarnHA
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/3771.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3771
----
commit 0e699241bf44dba220c8e7c59b764710c5075979
Author: huangzhaowei <[email protected]>
Date: 2014-12-23T04:07:01Z
Bug fix: fix the yarn-client code to support HA
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]