[
https://issues.apache.org/jira/browse/SPARK-45183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17766802#comment-17766802
]
hgs commented on SPARK-45183:
-----------------------------
I have compared Spark 3.2.0 with Spark 3.5.0. The deletion of pod is nothing
different in `ExecutorPodsLifecycleManager`.So I suspect the version 3.5.0 may
have the same issure.[~dongjoon]
> ExecutorPodsLifecycleManager delete a pod multi times.
> ------------------------------------------------------
>
> Key: SPARK-45183
> URL: https://issues.apache.org/jira/browse/SPARK-45183
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes
> Affects Versions: 3.2.0
> Environment: Spark 3.2.0
> Reporter: hgs
> Priority: Minor
>
> Because `ExecutorPodsLifecycleManager`.`removedExecutorsCache` is not thread
> safe, will cause a pod deleted many times when
> `ExecutorPodsLifecycleManager`.`onNewSnapshots` called by multi threads.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]