[GitHub] [spark] wfxxh commented on pull request #34378: spark executor pod anti affinity when run on k8s

Tue, 26 Oct 2021 01:16:38 -0700 


wfxxh commented on pull request #34378:
URL: https://github.com/apache/spark/pull/34378#issuecomment-951685133


        .setConf("spark.kubernetes.executor.label.YOURKEY", "YOURVALUE")
        .setConf("spark.kubernetes.executor.podAffinityKey", "YOURKEY")
        .setConf("spark.kubernetes.executor.podAffinityOperator", "In")
        .setConf("spark.kubernetes.executor.podAffinityValue", "YOURVALUE")
   
   Set spark config like above, YOURKEY must be the same and YOURVAULE must be 
the same too. 
   The executor started by the same driver can not be start on the same node.
   The different spark job must set different YOURKEY.
   
   
![图片](https://user-images.githubusercontent.com/22764286/138836459-0d9cde1c-d519-45b8-a395-3eb7d900db03.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to