[
https://issues.apache.org/jira/browse/SPARK-24765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nihal Harish updated SPARK-24765:
---------------------------------
Description:
spark submit currently does not accept any config parameter that can enable the
driver and executor pods to be scheduled by a custom scheduler as opposed to
just the default-scheduler.
I propose the addition of a new config parameter:
spark.kubernetes.schedulerName
was:
spark submit currently does not accept any config parameter that can enable the
driver and executor pods to be scheduled by a custom scheduler as opposed to
just the default-scheduler.
I propose the addition of three new config parameters:
spark.kubernetes.schedulerName
spark.kubernetes.driver.schedulerName
spark.kubernetes.executor.schedulerName
> Add custom Kubernetes scheduler config parameter to spark-submit
> -----------------------------------------------------------------
>
> Key: SPARK-24765
> URL: https://issues.apache.org/jira/browse/SPARK-24765
> Project: Spark
> Issue Type: New Feature
> Components: Kubernetes
> Affects Versions: 2.3.1
> Reporter: Nihal Harish
> Priority: Minor
>
> spark submit currently does not accept any config parameter that can enable
> the driver and executor pods to be scheduled by a custom scheduler as opposed
> to just the default-scheduler.
> I propose the addition of a new config parameter:
> spark.kubernetes.schedulerName
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
