[
https://issues.apache.org/jira/browse/SPARK-41419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644104#comment-17644104
]
Apache Spark commented on SPARK-41419:
--------------------------------------
User 'tedyu' has created a pull request for this issue:
https://github.com/apache/spark/pull/38948
> [K8S] Decrement PVC_COUNTER when the pod deletion happens
> ----------------------------------------------------------
>
> Key: SPARK-41419
> URL: https://issues.apache.org/jira/browse/SPARK-41419
> Project: Spark
> Issue Type: Task
> Components: Kubernetes
> Affects Versions: 3.4.0
> Reporter: Ted Yu
> Priority: Major
>
> commit cc55de3 introduced PVC_COUNTER to track outstanding number of PVCs.
> PVC_COUNTER should only be decremented when the pod deletion happens (in
> response to error).
> If the PVC isn't created successfully (where PVC_COUNTER isn't incremented)
> (possibly due to execution not reaching resource(pvc).create() call), we
> shouldn't decrement the counter.
> variable `success` tracks the progress of PVC creation:
> value 0 means PVC is not created.
> value 1 means PVC has been created.
> value 2 means PVC has been created but due to subsequent error, the pod is
> deleted.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
