Github user gerashegalov commented on a diff in the pull request:
https://github.com/apache/spark/pull/20327#discussion_r171748638
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala
---
@@ -123,6 +123,10 @@ class YarnClusterSuite extends BaseYarnClusterSuite {
checkResult(finalState, result)
}
+ test("yarn-cluster should use NM's public address instead of
SPARK_LOCAL_*") {
+ testBasicYarnApp(false, conf =
Map("spark.yarn.appMasterEnv.SPARK_LOCAL_IP" -> "1.1.1.1"))
--- End diff --
They are both valid addresses. `ping`-ability is orthogonal. the point was
that you can't bind to it.
```
$ nc -l 1.1.1.1 4040
nc: Can't assign requested address
```
your comment inspired me though to use 0.0.0.1 which can be used only as a
[source address](https://tools.ietf.org/rfc/rfc3330.txt) to signify the issue .
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
