LuciferYang commented on PR #58489: URL: https://github.com/apache/spark/pull/58489#issuecomment-5548582896
**7. resync > 0 replays N snapshots per round (churn only; off by default)** `resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsInformerSnapshotSource.scala:53` With `informerResyncInterval > 0`, each resync replays onUpdate for every pod; the handler calls `updatePod` unconditionally and `ExecutorPodsSnapshot.withUpdate` doesn't dedup by resourceVersion, so N executors produce N snapshot objects per round and both subscribers rescan everything. It's idempotent (`fullSnapshotTs` is preserved), so this is churn rather than a correctness issue, and the default resync=0 avoids it — just noting a driver-side cost proportional to the executor count when the interval is set low. Comparing resourceVersion before `updatePod` in the handler would cap it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
