GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/22164
[SPARK-23679][YARN] Fix AmIpFilter cannot work in RM HA scenario
## What changes were proposed in this pull request?
YARN `AmIpFilter` adds a new parameter "RM_HA_URLS" to support RM HA, but
Spark on YARN doesn't provide a such parameter, so it will be failed to
redirect when running on RM HA. The detailed exception can be checked from
JIRA. So here fixing this issue by adding "RM_HA_URLS" parameter.
## How was this patch tested?
Local verification.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jerryshao/apache-spark SPARK-23679
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22164.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22164
----
commit da33554cc38d4b41e86dcb6e2c833f5b29c35ad8
Author: jerryshao <sshao@...>
Date: 2018-08-20T08:28:13Z
Fix AmIpFilter cannot work in RM HA scenario
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
