[
https://issues.apache.org/jira/browse/SPARK-27334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16859599#comment-16859599
]
Dongjoon Hyun edited comment on SPARK-27334 at 6/9/19 11:16 PM:
----------------------------------------------------------------
As [~Alexander_Fedosov] pointed out, please use pod template at Spark 3.0.0.
{code}
spec:
schedulerName: my-scheduler
{code}
Although Apache Spark 3.0.0 is not released, new features are not allowed to be
backported to 2.4.x.
was (Author: dongjoon):
As [~Alexander_Fedosov] pointed out, please use pod template.
{code}
spec:
schedulerName: my-scheduler
{code}
> Support specify scheduler name for executor pods when submit
> ------------------------------------------------------------
>
> Key: SPARK-27334
> URL: https://issues.apache.org/jira/browse/SPARK-27334
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 2.4.0
> Reporter: TommyLike
> Priority: Major
> Labels: easyfix, features
> Fix For: 3.0.0
>
>
> Currently, there are some external schedulers which bring a lot a great value
> into kubernetes scheduling especially for HPC case, take a look at the
> *kube-batch* ([https://github.com/kubernetes-sigs/kube-batch]). In order to
> support it, we had to use Pod Template which seems cumbersome. It would be
> much convenient if this can be configured via option such as
> *"spark.kubernetes.executor.schedulerName"* just like others.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
