[
https://issues.apache.org/jira/browse/SPARK-35702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375941#comment-17375941
]
Holden Karau commented on SPARK-35702:
--------------------------------------
If you're running in client mode (e.g. notebook) does this matter?
> Kubernetes: Allow different namespaces for Driver and Executors
> ---------------------------------------------------------------
>
> Key: SPARK-35702
> URL: https://issues.apache.org/jira/browse/SPARK-35702
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.1.2
> Reporter: Christian Thiel
> Priority: Major
>
> Currently the Kubernetes namespace of driver AND executors always needs to be
> identical - specified with {{spark.kubernetes.namespace}}.
> Especially when developing in Kubernetes, this is a harsh restriction: In a
> _notebook_ Namespace I want to run spark in driver in client mode for
> interaction, however executors should get their own dedicated resources in a
> dedicated namespace with different policies and different lifecycles.
> This could be solved by adding the following two additional configuration
> options:
> {code:java}
> spark.kubernetes.executor.pod.namespace
> spark.kubernetes.driver.pod.namespace
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
