Holden Karau created SPARK-35956:
------------------------------------

             Summary: Support auto-assigning labels to less important pods 
(e.g. decommissioning pods)
                 Key: SPARK-35956
                 URL: https://issues.apache.org/jira/browse/SPARK-35956
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 3.2.0
            Reporter: Holden Karau
            Assignee: Holden Karau


To allow for folks to use pod disruption budgets or replicasets we should 
indicate which pods Spark cares about "the least", those would be pods that are 
otherwise exiting soon.

 

With PDBs the user would create a PDB representing the label of decommissioning 
executors and this could have a higher number of unavailable than the PDB for 
the "regular" execs. For people using replicasets in 1.21 we could also set a 
label of "controller.kubernetes.io/pod-deletion-cost" (see 
[https://github.com/kubernetes/kubernetes/pull/99163] ) to hint to the 
controller that a pod is less important to us.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to