[
https://issues.apache.org/jira/browse/SPARK-41781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Qian Sun updated SPARK-41781:
-----------------------------
Description:
Creating pvc after driver/executor pod has Warning event from
default-scheduler, such as
{code:java}
error getting PVC "spark/application-exec-1-pvc-0": could not find
v1.PersistentVolumeClaim "spark/application-exec-1-pvc-0" {code}
Normal k8s workflow is to create PVC first and schedule pod to mount PVC.
We have a scenes that webhook server will try to reschedule pod and pvc to
another pod. Because pvc creation after pod, wehbook couldn't find pvc based on
pod metadata.
was:
Creating pvc after driver/executor pod has Warning event from
default-scheduler, such as
{code:java}
error getting PVC "spark/application-exec-1-pvc-0": could not find
v1.PersistentVolumeClaim "spark/application-exec-1-pvc-0" {code}
Normally, we need to create PVC first and schedule pod to mount PVC.
> Add the ability to create pvc before creating driver/executor pod
> -----------------------------------------------------------------
>
> Key: SPARK-41781
> URL: https://issues.apache.org/jira/browse/SPARK-41781
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.3.0
> Reporter: Qian Sun
> Priority: Major
>
> Creating pvc after driver/executor pod has Warning event from
> default-scheduler, such as
> {code:java}
> error getting PVC "spark/application-exec-1-pvc-0": could not find
> v1.PersistentVolumeClaim "spark/application-exec-1-pvc-0" {code}
> Normal k8s workflow is to create PVC first and schedule pod to mount PVC.
>
> We have a scenes that webhook server will try to reschedule pod and pvc to
> another pod. Because pvc creation after pod, wehbook couldn't find pvc based
> on pod metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
