[
https://issues.apache.org/jira/browse/SPARK-20531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-20531.
----------------------------------
Resolution: Duplicate
> Spark master shouldn't send its address back to the workers over proxied
> connections
> ------------------------------------------------------------------------------------
>
> Key: SPARK-20531
> URL: https://issues.apache.org/jira/browse/SPARK-20531
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.3, 2.0.2, 2.1.2, 2.2.0
> Reporter: Sameer Agarwal
>
> Currently, when a Spark worker connects to Spark master, the master sends its
> address back to the worker (as part of the {{RegisteredWorker}} message). The
> worker then saves this address and use it to talk to the master. The reason
> behind this handshake protocol is that if the master goes down, a new master
> can always send back {{RegisteredWorker}} messages to all the workers with
> its (new) IP address.
> However, if there is a proxy between the master and worker, this
> unfortunately ends up bypassing the proxy. A simple fix here is that we
> should encode the "destination address" in the {{RegisterWorker}} that can
> then be sent back to the to the worker as part of the {{RegisteredWorker}}
> message.
> cc [~zsxwing]
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
