Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21748
> agreed with @echarles that it would be great if the submission client
will still create a headless service for the driver if the driver is running in
a pod in client mode.
The goal of this approach that specifically does not create a headless
service is so that the client mode implementation here is identical to the
client mode implementation of the other cluster managers. That is to say, the
other cluster managers for client mode don't make any assumptions about
connectivity, nor do they set up their own networking layers. Therefore I think
it's appropriate here to avoid the extra complexity.
> my pod has access to my host, so there is nothing to do on network level.
In other words, which are the steps to make this PR work in client mode for
Out-Cluster (assuming the network connectivity is OK)?
Can you share on how you know that your executor pod has access to your
host set by `spark.driver.host` and `spark.driver.port` over the network?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
