Github user echarles commented on the issue:
https://github.com/apache/spark/pull/20451
Current state works for out-cluster client mode.
For in-cluster, we miss the `DriverServiceBootstrapStep` of the fork which
"Allows the driver to be reachable by executor pods through a headless service.
The service's ports should correspond to the ports that the executor will reach
the pod at for RPC."
Running in cluster gives exception:
```
Caused by: java.io.IOException: Failed to connect to spark-pod:43957
at
org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:245)
at
org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:198)
Caused by: java.net.UnknownHostException: spark-pod
...
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
