[
https://issues.apache.org/jira/browse/SPARK-40350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sun BiaoBiao updated SPARK-40350:
---------------------------------
Description:
Now we use volcano as our scheduler， we need specify the following
configuration options:
{code:java}
spark.kubernetes.scheduler.name=volcano
spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
{code}
we should use configMap to mount the /path/to/podgroup-template.yaml file
If we use spark config to specify the parameters of the podgroup, it will be
much more convenient,we don't need configmap to mount static files
was:
Now we use volcano as our scheduler， we need specify the following
configuration options:
{code:java}
spark.kubernetes.scheduler.name=volcano
spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
{code}
we should use configMap to mount the /path/to/podgroup-template.yaml file
If we use spark config to specify the parameters of the podgroup, it will be
much more convenient, so that we don't need configmap to mount static files
> Improve the configuration of volcano scheduler
> ----------------------------------------------
>
> Key: SPARK-40350
> URL: https://issues.apache.org/jira/browse/SPARK-40350
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.3.0
> Reporter: Sun BiaoBiao
> Priority: Major
>
> Now we use volcano as our scheduler， we need specify the following
> configuration options:
>
>
> {code:java}
> spark.kubernetes.scheduler.name=volcano
> spark.kubernetes.scheduler.volcano.podGroupTemplateFile=/path/to/podgroup-template.yaml
> spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
> spark.kubernetes.executor.pod.featureSteps=org.apache.spark.deploy.k8s.features.VolcanoFeatureStep
> {code}
>
>
> we should use configMap to mount the /path/to/podgroup-template.yaml file
>
> If we use spark config to specify the parameters of the podgroup, it will be
> much more convenient,we don't need configmap to mount static files
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
