[
https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hendra Saputra updated SPARK-45278:
-----------------------------------
Description:
An improvement has been made in SPARK-24203 that executor's bind address is
configurable. Unfortunately this configuration hasn't implemented in Yarn.
When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the
executor to loopback interface or all interface. This Jira is to allow Yarn to
bind the executor to either pod IP or loopbak interface or all interface to
allow mesh integration like Istio with the cluster.
Another linked Jira explained this very well SPARK-42411
was:An improvement has been made in SPARK-24203 that executor's bind address
is configurable. Unfortunately this configuration hasn't implemented in Yarn.
When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the
executor to loopback interface or all interface. This Jira is to allow Yarn to
bind the executor to either pod IP or loopbak interface or all interface to
allow mesh integration like Istio with the cluster
> Make Yarn executor's bindAddress configurable
> ---------------------------------------------
>
> Key: SPARK-45278
> URL: https://issues.apache.org/jira/browse/SPARK-45278
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 4.0.0, 3.5.1
> Reporter: Hendra Saputra
> Assignee: Nishchal Venkataramana
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.0.0
>
>
> An improvement has been made in SPARK-24203 that executor's bind address is
> configurable. Unfortunately this configuration hasn't implemented in Yarn.
> When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the
> executor to loopback interface or all interface. This Jira is to allow Yarn
> to bind the executor to either pod IP or loopbak interface or all interface
> to allow mesh integration like Istio with the cluster.
> Another linked Jira explained this very well SPARK-42411
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
