holdenk opened a new pull request #34264:
URL: https://github.com/apache/spark/pull/34264


   
   ### What changes were proposed in this pull request?
   
   Add the ability to selectively disable watching or polling
   
   ### Why are the changes needed?
   
   Watching or polling for pod status on Kubernetes can place additional load 
on etcd, with a large number of executors and large number of jobs this can 
have negative impacts and executors register themselves with the driver under 
normal operations anyways.
   
   ### Does this PR introduce _any_ user-facing change?
   
   Two new config flags.
   
   
   ### How was this patch tested?
   
   New unit tests + manually tested a forked version of this on an internal 
cluster with both watching and polling disabled.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to