GitHub user gerashegalov opened a pull request:
https://github.com/apache/spark/pull/20327
[SPARK-12963][CORE] NM host for driver end points
## What changes were proposed in this pull request?
Driver end points on YARN in the cluster mode are potentially bound to
incorrect network interfaces because the host name is not retrieved from YARN
as in the executor container case.
## How was this patch tested?
On a cluster previously experiencing `Service 'Driver' failed after 16
retries (on a random free port) ...`
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gerashegalov/spark
gera/driver-host-on-in-yarn-cluster-mode
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20327.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20327
----
commit 016323a8d163e31052776a50590b47d9a38b6cdb
Author: Gera Shegalov <gera@...>
Date: 2018-01-19T06:05:32Z
[SPARK-12963][CORE] NM host for driver end points
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]